Commit Graph

482 Commits

Author SHA1 Message Date
I-Al-Istannen
8c431c7d81 Add a simple temporary folder 2020-04-20 12:08:52 +02:00
Joscha
d5dd5aac06 Fix some mypy errors 2020-04-20 01:54:47 +00:00
Joscha
7d48972967 Configure mypy 2020-04-19 19:50:17 +00:00
Joscha
25043a4aaa Remove unnecessary files
Also document some plans for the new program structure in REWRITE.md
2020-04-19 19:49:43 +00:00
Joscha
7ebeef5873 Clean up gitignore 2020-04-19 18:47:44 +00:00
Garmelon
9b658776ca
Merge pull request #6 from I-Al-Istannen/master
Hack in support for TI exams
2020-03-01 23:09:32 +00:00
I-Al-Istannen
cf3553175f Add OS_Exams synchronizer 2020-02-27 14:51:29 +01:00
I-Al-Istannen
bf8b3cf9f7 Hack in support for TI exams
This just adds an additional crawl check for AlteKlausuren. This is not
present on the root site but at the suffix `/Klausuren`.
Example config:

```py
 # The "Klausur" needs to be copied verbatim!
ti.synchronize("Klausur", "sync dir name",
               transform=ro_19_klausur_transform, filter=ro_19_klausur_filter)
```
2020-02-24 20:58:27 +01:00
Garmelon
4a5600d5ce
Merge pull request #5 from I-Al-Istannen/master
Lose 50 minutes of my life (and fix the TGI tut)
2019-12-12 11:52:05 +00:00
I-Al-Istannen
f5bc49160f Lose 50 minutes of my life (and fix the TGI tut) 2019-12-12 12:50:16 +01:00
Garmelon
fa5f82d312
Merge pull request #4 from I-Al-Istannen/master
[TGI] Add TGi tut
2019-11-18 22:12:32 +00:00
I-Al-Istannen
4433696509 [TGI] Add TGi tut 2019-11-18 09:58:16 +01:00
Garmelon
1f5475abc5
Merge pull request #3 from I-Al-Istannen/master
Download all TGI files and not just lectures
2019-10-17 21:10:21 +00:00
I-Al-Istannen
1407c6d264 Download all TGI files and not just lectures 2019-10-17 22:14:32 +02:00
Garmelon
e152bfc4a3
Merge pull request #2 from I-Al-Istannen/master
Add support for TGI
2019-10-15 20:01:10 +00:00
I-Al-Istannen
1973c931bd Add support for other years in TGI downloader 2019-10-15 15:37:52 +02:00
I-Al-Istannen
458cc1c6d6 Add support for TGI website 2019-10-15 15:34:59 +02:00
Joscha
52852d11a6 Bump version to 1.1.8 2019-09-22 11:56:41 +00:00
Joscha
f94629a7fa Fix exceptions with weird content types
(hopefully)
2019-09-22 11:55:47 +00:00
Joscha
c8ee456d33 Bump version to 1.1.7 2019-07-26 08:14:55 +00:00
I-Al-Istannen
2752e98621 Fix relative url joining in ti downloader 2019-07-26 10:06:01 +02:00
Joscha
1572e11da8 Bump version to 1.1.6 2019-07-05 08:49:26 +00:00
Joscha
ea01dc7cb2 Allow even more types of files 2019-07-05 08:48:43 +00:00
Joscha
aba8d46d26 Bump version to 1.1.5 2019-07-04 12:17:33 +00:00
Joscha
77056e6f8d Allow more types of files 2019-07-04 12:16:42 +00:00
Joscha
064f12c14c Ignore mypy files 2019-07-04 12:16:26 +00:00
Joscha
2eb834afc3 Bump version to 1.1.4 2019-06-11 12:46:40 +00:00
Joscha
d468a45662 Allow wolfram files 2019-06-11 12:42:55 +00:00
Joscha
50e25346e5 Bump version to 1.1.3 2019-06-07 11:36:41 +00:00
I-Al-Istannen
67da4e69fa Add colorful log output
Highlight the important operations (new, modified) in different colours.
2019-06-07 13:28:55 +02:00
Joscha
da602366f8 Bump version to 1.1.2 2019-05-17 07:43:32 +00:00
Joscha
2016f61bf8 Crawl more of the TI page 2019-05-09 11:04:24 +00:00
Joscha
59c278da2c Bump version to 1.1.1 2019-05-06 12:07:12 +00:00
Joscha
c72e92db18 Make Ti downloader authentication more robust 2019-05-06 12:04:01 +00:00
Joscha
44b4204517 Add basic Ti downloader 2019-05-06 11:54:36 +00:00
Joscha
11b9ff66e4 Bump version to 1.1.0 2019-04-26 09:48:17 +00:00
Joscha
d730d0064c Conform to other files' __all__ 2019-04-26 09:45:24 +00:00
Joscha
ae6cc40fb5 Rename ILIAS crawler to ilias
To be consistent with the other classes' capitalisation of acronyms
2019-04-26 04:29:12 +00:00
Joscha
0891e7f1bc Fix logging messages not appearing 2019-04-26 03:58:11 +00:00
Joscha
571c2a6c98 Clean up README structure 2019-04-25 20:04:50 +00:00
Joscha
2d7a2b2d53 Add more usage examples 2019-04-25 20:01:50 +00:00
Joscha
8550d1101c Fix backronym in README 2019-04-25 19:59:21 +00:00
Joscha
fd71dc6f6e Use python3 everywhere in README 2019-04-25 19:57:04 +00:00
Joscha
d48cbebbd4 Bump version to 1.0.0 2019-04-25 19:55:15 +00:00
Joscha
bc018fffde Update the example config to the new version 2019-04-25 19:54:15 +00:00
Joscha
9693e1d968 Make logging easier 2019-04-25 19:53:13 +00:00
Joscha
5e9ecd3ce1 Add example setup steps 2019-04-25 19:30:02 +00:00
Joscha
f1ba618378 Remove unnecessary files 2019-04-25 19:18:19 +00:00
Joscha
dfddc93039 Move norbert from aiohttp to requests
Also fix streaming (when downloading) in the other classes.
2019-04-25 19:15:36 +00:00
Joscha
f0c42ce8ec Clean up
Use shorter name for responses, like in the requests doc.

Change Organizer's __all__ to be more in line with the other __all__s.
2019-04-25 19:02:48 +00:00