backend/scripts/crawl_atelier.py
Recursive crawler for atelierneyra.com using Scrapling StealthyFetcher. Renders JS (Squarespace) and extracts all internal links + page content.
| Symbol | Kind | Source line |
|---|---|---|
is_internal |
FunctionDef | L24 |
normalize_url |
FunctionDef | L29 |
extract_links |
FunctionDef | L35 |
extract_text |
FunctionDef | L48 |
crawl_page |
AsyncFunctionDef | L59 |
main |
AsyncFunctionDef | L102 |