mirrors/pferd
1
0
Fork 0
mirror of https://github.com/Garmelon/PFERD.git synced 2025-07-12 22:22:30 +02:00
Code Issues Packages Projects Releases Wiki Activity

Ignore unavailable elements (#119)

Browse Source
This commit is contained in:
Mr. Pine
2025-05-28 17:04:57 +02:00
committed by GitHub
parent 34564cedb4
commit 549ce6cce9
2 changed files with 12 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
CHANGELOG.md
View File

@ -30,6 +30,9 @@ ambiguous situations.
## Fixed ## Fixed
- Crawling of exercises with instructions - Crawling of exercises with instructions
- Don't download unavailable elements.
Elements that are unavailable (for example, because their availability is
time restricted) will not download the HTML for the info page anymore.
## 3.8.2 - 2025-04-29 ## 3.8.2 - 2025-04-29

9
PFERD/crawl/ilias/ilias_web_crawler.py
View File

@ -329,6 +329,15 @@ instance's greatest bottleneck.
# directory escape attacks. # directory escape attacks.
element_path = PurePath(parent_path, element.name) element_path = PurePath(parent_path, element.name)
# This is symptomatic of no access to the element, for example, because
# of time availability restrictions.
if "cmdClass=ilInfoScreenGUI" in element.url and "cmd=showSummary" in element.url:
log.explain(
"Skipping element as url points to info screen, "
"this should only happen with not-yet-released elements"
)
return None
if element.type in _VIDEO_ELEMENTS: if element.type in _VIDEO_ELEMENTS:
if not self._videos: if not self._videos:
log.status( log.status(