mirrors/pferd
1
0
Fork 0
mirror of https://github.com/Garmelon/PFERD.git synced 2023-12-21 10:23:01 +01:00
Code Issues Packages Projects Releases Wiki Activity
52 Commits 6 Branches 43 Tags 1.6 MiB
da602366f8
Commit Graph

52 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Joscha
da602366f8 Bump version to 1.1.2 2019-05-17 07:43:32 +00:00
Joscha
2016f61bf8 Crawl more of the TI page 2019-05-09 11:04:24 +00:00
Joscha
59c278da2c Bump version to 1.1.1 2019-05-06 12:07:12 +00:00
Joscha
c72e92db18 Make Ti downloader authentication more robust 2019-05-06 12:04:01 +00:00
Joscha
44b4204517 Add basic Ti downloader 2019-05-06 11:54:36 +00:00
Joscha
11b9ff66e4 Bump version to 1.1.0 2019-04-26 09:48:17 +00:00
Joscha
d730d0064c Conform to other files' __all__ 2019-04-26 09:45:24 +00:00
Joscha
ae6cc40fb5 Rename ILIAS crawler to ilias 
To be consistent with the other classes' capitalisation of acronyms
 2019-04-26 04:29:12 +00:00
Joscha
0891e7f1bc Fix logging messages not appearing 2019-04-26 03:58:11 +00:00
Joscha
571c2a6c98 Clean up README structure 2019-04-25 20:04:50 +00:00
Joscha
2d7a2b2d53 Add more usage examples 2019-04-25 20:01:50 +00:00
Joscha
8550d1101c Fix backronym in README 2019-04-25 19:59:21 +00:00
Joscha
fd71dc6f6e Use python3 everywhere in README 2019-04-25 19:57:04 +00:00
Joscha
d48cbebbd4 Bump version to 1.0.0 2019-04-25 19:55:15 +00:00
Joscha
bc018fffde Update the example config to the new version 2019-04-25 19:54:15 +00:00
Joscha
9693e1d968 Make logging easier 2019-04-25 19:53:13 +00:00
Joscha
5e9ecd3ce1 Add example setup steps 2019-04-25 19:30:02 +00:00
Joscha
f1ba618378 Remove unnecessary files 2019-04-25 19:18:19 +00:00
Joscha
dfddc93039 Move norbert from aiohttp to requests 
Also fix streaming (when downloading) in the other classes.
 2019-04-25 19:15:36 +00:00
Joscha
f0c42ce8ec Clean up 
Use shorter name for responses, like in the requests doc.

Change Organizer's __all__ to be more in line with the other __all__s.
 2019-04-25 19:02:48 +00:00
Joscha
82adeb324f Move ffm stuff from aiohttp to requests 2019-04-25 19:01:53 +00:00
Joscha
9bae030186 Move ilias stuff from aiohttp to requests 2019-04-25 18:52:48 +00:00
Joscha
0e536f476a Reorganize project structure 2019-04-25 11:51:03 +00:00
Joscha
45e4500a58 Update example config 2019-04-25 08:32:25 +00:00
Joscha
c7a9a42b3d Allow files of type application/msword 2019-04-24 12:34:50 +00:00
Joscha
5a1bf2188b Switch from tabs to spaces 2019-04-24 12:34:20 +00:00
Joscha
c3e64da570 Update example config 2019-02-08 12:56:24 +00:00
Joscha
c2fc097124 Adapt to different LA1 folder structure 2018-12-14 09:28:29 +00:00
Joscha
3019e4255b Replace "/" in file names with "." 2018-12-14 09:27:12 +00:00
Joscha
616a8d96a2 Sort norbert files while downloading 2018-12-05 11:44:35 +00:00
Joscha
f8cd5edb75 Fix some typos on ilias 2018-12-05 11:44:11 +00:00
Joscha
2d9223b8e6 Add norbert synchronizer 2018-11-29 10:26:58 +00:00
Joscha
bdc0e8ad03 Remember files correctly for cleanin up 2018-11-28 08:59:07 +00:00
Joscha
dad33b8c7f Save identically named files under different names 2018-11-27 17:23:32 +00:00
Joscha
98a2b5db34 Fix tut crawling 2018-11-27 10:28:39 +00:00
Joscha
c824ae4f6d Add more allowed file types 2018-11-27 10:27:20 +00:00
Joscha
9a4ab645dc Clean up Prog slide names 2018-11-27 10:26:44 +00:00
Joscha
8b1a34233a Add and use utility functions for changing paths 
This fixes a small bug in the example config, where some files were
put in the wrong locations.
 2018-11-27 08:52:27 +00:00
Joscha
a084b05433 Change log message 
for better readability
 2018-11-26 17:33:27 +00:00
Joscha
21ddf2546d Use more complicated example config 2018-11-26 17:06:46 +00:00
Joscha
068fe77dcf Clean up minor things 
- improve logging messages
- allow more download file formats
- strip file names
 2018-11-26 17:00:17 +00:00
Joscha
34da5d4d19 Sync files from ILIAS 2018-11-26 13:39:06 +00:00
Joscha
529c4a7dda Don't overwrite files if the contents match 2018-11-26 13:37:01 +00:00
Joscha
2034c9d426 Add FfM (Fachschaft für Mathematik) synchronizer 
This commit moves exceptions and some other things into utils.py and
renames files according to python's file naming guides (kinda).

It also adds a new example config using the new FfM downloader.
 2018-11-24 08:27:33 +00:00
Joscha
5732268084 Clean up 
- detect whether authenticating is really necessary when attempting to
download a file
- add a get_website_refid() function
- move often-used goto.php url into constant
- and some comments
 2018-11-23 17:45:07 +00:00
Joscha
2afcd38f1c Rename Ilias-specific stuff 2018-11-23 10:09:03 +00:00
Joscha
5d5f60e21f Log properly 2018-11-23 10:08:31 +00:00
Joscha
282d0252eb Add file organizer 2018-11-23 08:56:59 +00:00
Joscha
4e6912591c Download files to some local file 2018-11-23 08:53:49 +00:00
Joscha
cf9d43fe84 Fix authenticating bug 2018-11-21 06:59:34 +00:00