Rename files and fix remaining errors with headlines

This commit is contained in:
heyarne 2021-03-01 17:14:47 +00:00
commit 81845d2d93
10 changed files with 629 additions and 766 deletions

View file

@ -4,20 +4,21 @@
title: "Remote Sensing for Journalism"
- part: "Data Retrieval and Processing"
chapters:
- file: "sources/01 Data retrieval and processing.md"
- file: "sources/01 Overview.md"
- file: "sources/01a Download from Scihub.ipynb"
- file: "sources/01b Plot downloaded products.ipynb"
- file: "sources/01c Coverage analysis.ipynb"
- file: "sources/1d Brandenburg mosaic.ipynb"
- file: "sources/01 True-color pipeline.ipynb"
- file: "sources/01e True-color pipeline.ipynb"
- part: "Spectral Indices"
chapters:
- file: "sources/02a NDVI.ipynb"
- file: "sources/02b Timeseries.ipynb"
sections:
- file: "sources/02c Corrupted Zip File.ipynb"
- file: "sources/02c Multithreading.ipynb"
- file: "sources/02d Cloud Masks.ipynb"
- file: "sources/02 Spectral Indices.ipynb"
- file: "sources/02e Spectral Indices.ipynb"
- part: "Burn Ratio Calculations"
chapters:
- file: "sources/03a Forest Fire Product Downloads.ipynb"

View file

@ -404,6 +404,13 @@
"products[products['title'].str.startswith('S2A')]['orbitnumber'].unique()"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Compared to the area numbers of the S2B satellite:"
]
},
{
"cell_type": "code",
"execution_count": 15,
@ -434,11 +441,11 @@
"What is the minimum time span in those four weeks to ensure a coverage of all of Brandenburg?\n",
"To find out we iterate through the returned products, for each iteration $i$ unifying the associated product's geometry $P_i$ with all products we already iterated through:\n",
"\n",
"\\begin{align}\n",
"P &= \\{P_1, P_2, \\cdots, P_n\\} \\\\\n",
"U_1 &= \\{\\} \\\\\n",
"U_{n+1} &= U_{n} \\cup P_n\n",
"\\end{align}\n",
"$$\n",
"P = \\{P_1, P_2, \\cdots, P_n\\} \\\\\n",
"U_1 = \\{\\} \\\\\n",
"U_{n+1} = U_{n} \\cup P_n\n",
"$$\n",
"\n",
"Given the shape of Brandenburg $B$ the condition for termination is when $B$ is contained entirely in the unified shape $U_n$:\n",
"\n",

View file

@ -2991,6 +2991,468 @@
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "1b03205b5e1d46d094f704d387c65121",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"HBox(children=(HTML(value='MD5 checksumming'), FloatProgress(value=0.0, max=1141855142.0), HTML(value='')))"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "b3af441a7c7e4ab2ab67a768fb611e9c",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"HBox(children=(HTML(value='Downloading'), FloatProgress(value=0.0, max=557546579.0), HTML(value='')))"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "cf9771ed383046eeb19a4f7c4ade25d8",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"HBox(children=(HTML(value='MD5 checksumming'), FloatProgress(value=0.0, max=483262481.0), HTML(value='')))"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "ba5634631f464eedaa897d841d301b42",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"HBox(children=(HTML(value='Downloading'), FloatProgress(value=0.0, max=508152307.0), HTML(value='')))"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "17317cefbae345faa175a9034409f541",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"HBox(children=(HTML(value='MD5 checksumming'), FloatProgress(value=0.0, max=557546579.0), HTML(value='')))"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "9e67824998384e8a9173e83d5571a551",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"HBox(children=(HTML(value='Downloading'), FloatProgress(value=0.0, max=799354785.0), HTML(value='')))"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "8974dd5149314e7aa74d9e4f6dadb094",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"HBox(children=(HTML(value='MD5 checksumming'), FloatProgress(value=0.0, max=508152307.0), HTML(value='')))"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "4c945952b30b4576bf3318b425c21cba",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"HBox(children=(HTML(value='Downloading'), FloatProgress(value=0.0, max=134510154.0), HTML(value='')))"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "58acf5e9e03f447b8ec2988fd03ad0ef",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"HBox(children=(HTML(value='MD5 checksumming'), FloatProgress(value=0.0, max=134510154.0), HTML(value='')))"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "7c366a5a4d5540269253bfb985d94281",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"HBox(children=(HTML(value='Downloading'), FloatProgress(value=0.0, max=851154495.0), HTML(value='')))"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "a36bbd02784c4d1cb973ec90da145308",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"HBox(children=(HTML(value='MD5 checksumming'), FloatProgress(value=0.0, max=799354785.0), HTML(value='')))"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "c34a5264c30c47d7b59a09858dcf4d15",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"HBox(children=(HTML(value='Downloading'), FloatProgress(value=0.0, max=556259916.0), HTML(value='')))"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "a96bde1b49724694b543cec019b8ace6",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"HBox(children=(HTML(value='MD5 checksumming'), FloatProgress(value=0.0, max=851154495.0), HTML(value='')))"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "4acde55600dc487ea619aa7f59c2aa60",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"HBox(children=(HTML(value='Downloading'), FloatProgress(value=0.0, max=506035622.0), HTML(value='')))"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "682de63faffa4b68bfbb6ee923f37e1d",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"HBox(children=(HTML(value='MD5 checksumming'), FloatProgress(value=0.0, max=556259916.0), HTML(value='')))"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "6baacd3dcadc4b379af93c8f04c5f494",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"HBox(children=(HTML(value='Downloading'), FloatProgress(value=0.0, max=495180498.0), HTML(value='')))"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "e0cfbb489f7e4c03bccd0e8358440277",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"HBox(children=(HTML(value='MD5 checksumming'), FloatProgress(value=0.0, max=506035622.0), HTML(value='')))"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "385e41e7ed0e4b8da0beb7863359da69",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"HBox(children=(HTML(value='Downloading'), FloatProgress(value=0.0, max=1103411496.0), HTML(value='')))"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "b607ba6a19cc40cfaeba8000a8f30429",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"HBox(children=(HTML(value='MD5 checksumming'), FloatProgress(value=0.0, max=495180498.0), HTML(value='')))"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "c477250829a347b6a3f368b6dd90f1fd",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"HBox(children=(HTML(value='Downloading'), FloatProgress(value=0.0, max=995177343.0), HTML(value='')))"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "67ed5567a9f34f4a8b6099c7b965147c",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"HBox(children=(HTML(value='MD5 checksumming'), FloatProgress(value=0.0, max=1103411496.0), HTML(value='')))"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "8488cd11a218407d8be7bdcd5c0039a7",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
"HBox(children=(HTML(value='Downloading'), FloatProgress(value=0.0, max=804654613.0), HTML(value='')))"
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [

View file

@ -4,7 +4,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"## Corrupted Zipfiles\n",
"# Corrupted Zipfiles\n",
"\n",
"Out of the 40 files we were trying to download, some needed to be fetched from the [Long-Term Archive](https://scihub.copernicus.eu/userguide/#LTA_Long_Term_Archive_Access).\n",
"After retrying the download several times, all files could be retrieved.\n",
@ -173,7 +173,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"# Do the downloads fail repeatedly?\n",
"## Do the downloads fail repeatedly?\n",
"\n",
"All files have been downloaded again to another folder, `input/tempelhofer_feld_test`."
]

View file

@ -247,7 +247,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"# Result\n",
"## Result\n",
"\n",
"As we can see when processing a single element, multiprocessing comes with an overhead.\n",
"When the list to be processed is sufficiently large, we get a reduction in processing time of roughly 30%-50%, depending on list size.\n",

View file

@ -1,5 +1,12 @@
{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"# Spectral Index Pipeline"
]
},
{
"cell_type": "code",
"execution_count": 1,

File diff suppressed because one or more lines are too long

File diff suppressed because one or more lines are too long