Floke
8dfe7d23ec
- Refactors the website scraping batch process to fix critical stability issues. - Replaces multiple redundant and conflicting scraping functions (`_scrape_website_task`, `_scrape_raw_text_task`, `_scrape_and_summarize_task`) with a single, robust worker function: `_scrape_website_task_batch`. - The new worker function now consistently returns a structured dictionary, resolving the `TypeError` that prevented results from being written to the sheet. - The main batch function `process_website_scraping_batch` is updated to correctly handle this new dictionary structure, including error states. - Functionality is now aligned with the single-row processing mode by also fetching meta-details in the batch process, not just raw text. - The two large, duplicated, and now obsolete `process_website_scraping` functions have been removed to improve code clarity and maintainability.