Commit Graph

255 Commits

Author SHA1 Message Date
I-Al-Istannen
a0ae9aee27 Sanitize individual path parts 2020-11-11 09:36:20 +01:00
I-Al-Istannen
1486a63854 Do not collapse directory structure when sanitizing 2020-11-10 22:53:47 +01:00
I-Al-Istannen
733e1ae136 Bump version 2020-11-10 20:50:31 +01:00
I-Al-Istannen
4ac51048c1 Use "_" as a replacement for illegal characters 2020-11-10 20:49:14 +01:00
I-Al-Istannen
f2aba970fd [sync_url] Sanitize path names on windows 2020-11-10 17:16:14 +01:00
I-Al-Istannen
9c4759103a Bump patch version 2020-11-05 11:25:06 +01:00
I-Al-Istannen
316b9d7bf4 Prevent too many retries when fetching an ILIAS page 2020-11-04 22:23:56 +01:00
I-Al-Istannen
6f30adcd22 Fix quote type in README 2020-11-04 22:13:08 +01:00
I-Al-Istannen
6f78fef604 Add quoting instructions to README 2020-11-04 22:08:33 +01:00
I-Al-Istannen
f830b42a36 Fix duplicate files in download summary 2020-11-04 21:49:35 +01:00
I-Al-Istannen
ef343dec7c Merge organizer download summaries 2020-11-04 15:06:58 +01:00
I-Al-Istannen
0da2fafcd8 Fix links outside tables 2020-11-04 14:46:15 +01:00
I-Al-Istannen
f4abe3197c Add ipd crawler 2020-11-03 21:15:40 +01:00
I-Al-Istannen
38d4f5b4c9 Do not fail only empty courses 2020-11-03 20:09:54 +01:00
I-Al-Istannen
9ea03bda3e Adjust release names 2020-10-30 18:14:02 +01:00
I-Al-Istannen
07de5bea8b Explain how to run sync_url on Mac 2020-10-30 17:53:55 +01:00
I-Al-Istannen
f0d572c110 Fix a few typos in release body 2020-10-30 17:32:04 +01:00
I-Al-Istannen
076067e22d Bump version 2020-10-30 17:28:34 +01:00
I-Al-Istannen
ebb6e63c5c Add MacOS to CI 2020-10-30 17:23:27 +01:00
I-Al-Istannen
0c3f35a2d2 Do not provide a shorthand for "no-videos" 2020-10-30 17:01:10 +01:00
I-Al-Istannen
521890ae78
Update README.md 2020-10-28 23:24:18 +01:00
I-Al-Istannen
3f7c73df80 Release new minor version 2020-10-07 09:32:17 +02:00
I-Al-Istannen
43100f69d5
Merge pull request #10 from Garmelon/sync-url
Add "Sync url" script from Christophe and release it automatically
2020-10-07 09:29:48 +02:00
I-Al-Istannen
d73c778b0a Add sync_url instructions to README 2020-10-06 17:50:28 +02:00
I-Al-Istannen
73c3eb0984 Add option to skip videos in sync_url 2020-10-06 17:20:47 +02:00
I-Al-Istannen
a519cbe05d Add sync_url workflow 2020-10-06 12:42:20 +02:00
I-Al-Istannen
b3ad9783c4 Ignore pyinstaller files 2020-10-06 11:43:20 +02:00
I-Al-Istannen
c1ccb6c53e Allow crawling videos with sync_url 2020-10-06 10:46:06 +02:00
I-Al-Istannen
51a713fa04 Allow crawling courses or folders with sync_url
Video folders do not work, if they are passed directly. Their containing
folder must be specified instead.
2020-09-28 20:00:01 +02:00
I-Al-Istannen
74ea039458 Fix a few lint errors and pferd quirks in sync_url 2020-09-28 19:42:59 +02:00
I-Al-Istannen
aaa6a2b6a4
Merge pull request #9 from TheChristophe/master
Add simple course-download-by-url script
2020-09-28 19:25:45 +02:00
I-Al-Istannen
e32a49480b Expose methods to look up course/element names by id / url 2020-09-28 19:16:52 +02:00
Christophe
be65051f9d Support downloading folders in get-by-url script 2020-09-28 18:16:33 +02:00
Christophe
3387bc5f20 Add simple course-download-by-url script 2020-09-28 17:49:36 +02:00
I-Al-Istannen
3f0ae729d6 Expand "is course" check to not download magazines or other weird things 2020-09-28 16:43:58 +02:00
I-Al-Istannen
8e8c1c031a Version 2.3.0 2020-09-03 21:47:10 +02:00
I-Al-Istannen
55678d7fee Pass string down to FileCookieJar
Some python versions just can't handle it *despite the documentation
stating they should*.
2020-08-12 09:09:14 +02:00
I-Al-Istannen
a57ee8b96b Add timeout to video downloads to work around requests IPv6 bug 2020-08-11 14:40:30 +02:00
Joscha
e367da925e Bump version to 2.2.1 2020-07-28 19:55:32 +00:00
Joscha
77a109bb7e Fix ilias shibboleth authenticator
The shibboleth site got a visual overhaul that slightly changed the classes of a
form we need.
2020-07-28 19:13:51 +00:00
I-Al-Istannen
a3e1864a26 Allow long paths on windows
If you start PFERD a few folders deep in your home directory, it is
quite easy to reach the maximum path length limit on Windows (260
chars). This patch opts in to long paths ("\\?\" prefix) which lift that
restriction at the cost of ugly path names.
2020-07-25 13:44:49 +02:00
I-Al-Istannen
41cbcc509c Update version to 2.2.0 2020-07-15 22:47:44 +02:00
I-Al-Istannen
77874b432b Also add personal_desktop to download summary 2020-07-15 22:47:44 +02:00
I-Al-Istannen
5c4c785e60 Fix HTML file downloading
Previously PFERD thought any HTML file was a "Error, no access" page
when downloading. Now it checks whether ILIAS sends a
content-disposition header, telling the browser to download the file. If
that is the case, it was just a HTML file uploaded to ILIAS. If it has
no header, it is probably an error message.
2020-07-15 15:12:14 +02:00
I-Al-Istannen
2aed4f6d1f Only query the dir_filter for directories 2020-07-13 13:36:12 +02:00
I-Al-Istannen
34152fbe54 Set mtime and atime to ILIAS dates where possible 2020-07-13 13:29:18 +02:00
Joscha
4047fe78f3 Fix README formatting 2020-07-11 18:22:33 +00:00
Joscha
c28347122e Improve README
- Added a table of contents
- Reworked the transform section
- Fixed the commented example
2020-07-11 18:16:33 +00:00
Joscha
5b38ab8cf1 Add MIT license 2020-07-08 09:46:27 +00:00
I-Al-Istannen
bb25d32f03 Fix typo in README 2020-06-29 16:18:33 +02:00