Commit graph

9 commits

Author SHA1 Message Date
Arne Schlüter
7c4cf8f9f0 Clean up code, clarify and remove an unnecessary try-except-block 2014-12-11 00:29:08 +01:00
Arne Schlüter
98d1e21a90 Remove field 'addtional_place' because it can't be reliably parsed 2014-12-11 00:07:48 +01:00
Arne Schlüter
36df116ed0 Crawl all pages and insert them into the database 2014-12-08 18:26:25 +01:00
Arne Schlüter
5306e6dab4 Merge branch 'dev-arne'
Conflicts:
	scraper/scraper.py
2014-12-08 16:20:08 +01:00
Joshua Widmann
c872c8e39d renamed article attributes according to database fields 2014-12-08 15:59:33 +01:00
Joshua Widmann
9ae38d3279 scraping all articles 2014-12-08 15:38:58 +01:00
Arne Schlüter
58f8e65669 Simplify code by removing :nth-of-type and accessing the list directly 2014-12-08 14:46:26 +01:00
Arne Schlüter
66b68b269d Normalize \r\n to \n and use date objects instead of the original date string 2014-12-08 14:40:05 +01:00
Arne Schlüter
0744167bde Implement basic article scraping 2014-11-17 18:25:46 +01:00