Commit Graph

1637 Commits

Author SHA1 Message Date
db1bfdfc67 docs(migration): Finalize Competitor Analysis migration & document all pitfalls 2026-01-10 20:49:54 +01:00
6705d7dd9d docs(migration): Finalize Competitor Analysis migration lessons and code 2026-01-10 18:26:23 +01:00
6c46c0d7e7 docs: Comprehensive lessons learned from Competitor Analysis migration 2026-01-10 17:47:58 +01:00
8e5ab8949b feat(competitor-analysis): Fix 404, SDK compatibility, and update docs
Resolved multiple issues preventing the 'competitor-analysis' app from running and serving its frontend:

1.  **Fixed Python SyntaxError in Prompts:** Corrected unterminated string literals and ensure proper multi-line string formatting (using .format() instead of f-strings for complex prompts) in .
2.  **Addressed Python SDK Compatibility (google-generativeai==0.3.0):**
    *   Removed  for  and  by adapting the orchestrator to pass JSON schemas as direct Python dictionaries, as required by the older SDK version.
    *   Updated  with detailed guidance on handling / imports and dictionary-based schema definitions for older SDKs.
3.  **Corrected Frontend Build Dependencies:** Moved critical build dependencies (like , , ) from  to  in .
    *   Updated  to include this  pitfall, ensuring frontend build tools are installed in Docker.
4.  **Updated Documentation:**
    *   : Added comprehensive lessons learned regarding  dependencies, Python SDK versioning (specifically  and  imports for ), and robust multi-line prompt handling.
    *   : Integrated specific details of the encountered errors and their solutions, making the migration report a more complete historical record and guide.

These changes collectively fix the 404 error by ensuring the Python backend starts correctly and serves the frontend assets after a successful build.
2026-01-10 09:10:00 +00:00
ff5184a26e Dateien nach "competitor-analysis/services" hochladen 2026-01-09 17:43:28 +00:00
dd773b1fcc competitor-analysis/services/geminiService.ts hinzugefügt 2026-01-09 17:43:14 +00:00
53bf584835 Dateien nach "competitor-analysis/components" hochladen 2026-01-09 17:41:40 +00:00
be6b83ea9b Dateien nach "competitor-analysis/components" hochladen 2026-01-09 17:41:23 +00:00
127df26c7c Dateien nach "competitor-analysis/components" hochladen 2026-01-09 17:41:05 +00:00
227477d4b9 competitor-analysis/components/EditableCard.tsx hinzugefügt 2026-01-09 17:40:48 +00:00
63854ab822 Dateien nach "competitor-analysis" hochladen 2026-01-09 17:38:37 +00:00
32bbb3799b Dateien nach "competitor-analysis" hochladen 2026-01-09 17:38:36 +00:00
d5458a1fe9 Dateien nach "competitor-analysis" hochladen 2026-01-09 17:38:22 +00:00
1311a2bb7d competitor-analysis/App.tsx hinzugefügt 2026-01-09 17:38:01 +00:00
b0ffc29eb2 Docs: Update MIGRATION_PLAN.md to v0.4.0 with new features (Company Explorer) 2026-01-09 10:18:45 +00:00
642e0af1f4 Update: GTM Architect v2.6.2 (Edit Specs, Report Fix) & Company Explorer v0.4 (Export, Timestamps) 2026-01-09 09:15:16 +00:00
fc0f873713 fix(gtm): Fix white screen and implement URL persistence v2.6.1
- Fixed TypeError in SessionBrowser by adding defensive checks for the sessions array.
- Implemented mandatory URL persistence: The research URL is now saved in DB, shown in UI, and included in reports.
- Added 'Start New Analysis' button to the session browser for better UX flow.
- Updated documentation to reflect v2.6.1 changes.
2026-01-08 21:36:42 +00:00
0281387f87 feat(gtm): Implement Rich Session Browser UI
- Replaced the basic session list with a dedicated, card-based Session Browser page.
- Each session card now displays product name, category, description, and a thumbnail placeholder for better usability.
- Updated the backend DB manager to extract this rich information from the existing JSON data store.
- Refactored the frontend (App.tsx, types.ts) to support the new UI and data structure.
- Added new component SessionBrowser.tsx and its corresponding CSS.
- Updated documentation to reflect the v2.6 changes.
2026-01-08 21:23:46 +00:00
57206d0916 feat(notion): Finalize relational DB implementation and scripts
- Implement relational data structure in Notion as per the plan.
- Add scripts for initial data import (import_product.py) and distribution to related databases (distribute_product_data.py).
- Create helper scripts for reading Notion content.
- Update Notion_Dashboard.md and GEMINI.md with the latest implementation status, database IDs, and key lessons learned from the MVP phase, including API constraints and schema-first principles.
2026-01-08 21:07:12 +00:00
52cc86c1bf docker/gemini/Dockerfile hinzugefügt 2026-01-08 20:08:03 +00:00
d89da212e3 notion_token.txt hinzugefügt 2026-01-08 19:31:05 +00:00
77bd70884c Docs: Documented successful Notion DB setup and Puma M20 import; Added setup and import scripts. 2026-01-08 16:39:47 +00:00
9636260477 fix(company-explorer): handle inconsistent LLM list responses in scraper
- Added logic to automatically flatten list-wrapped JSON responses from LLM in Impressum extraction.
- Fixed 'Unknown Legal Name' issue by ensuring property access on objects, not lists.
- Finalized v0.3.0 features and updated documentation with Lessons Learned.
2026-01-08 16:14:01 +01:00
44b78bd6b6 fix(company-explorer): enhance impressum scraping debug logging
- Increased logging verbosity in  to track raw input to LLM and raw LLM response.
- This helps diagnose why Impressum data extraction might be failing for specific company websites.
2026-01-08 16:14:01 +01:00
725ba3a096 feat(company-explorer): force-refresh analysis and refine extraction logic
- Enforced fresh scrape on 'Analyze' request to bypass stale cache.
- Implemented 2-Hop Impressum scraping strategy (via Kontakt page).
- Refined numeric extraction for German locale (thousands separators).
- Updated documentation with Lessons Learned.
2026-01-08 16:14:01 +01:00
e684f33bed feat(company-explorer): bump version to 0.3.0, add VAT ID extraction, and fix deep-link scraping
- Updated version to v0.3.0 (UI & Backend) to clear potential caching confusion.
- Enhanced Impressum scraper to extract VAT ID (Umsatzsteuer-ID).
- Implemented 2-Hop scraping strategy: Looks for 'Kontakt' page if Impressum isn't on the start page.
- Added VAT ID display to the Legal Data block in Inspector.
2026-01-08 16:14:01 +01:00
88c9d487be feat(company-explorer): add impressum scraping, robust json parsing, and enhanced ui polling
- Implemented Impressum scraping with Root-URL fallback and enhanced keyword detection.
- Added 'clean_json_response' helper to strip Markdown from LLM outputs, preventing JSONDecodeErrors.
- Improved numeric extraction for German formatting (thousands separators vs decimals).
- Updated Inspector UI with Polling logic for auto-refresh and display of AI Dossier and Legal Data.
- Added Manual Override for Website URL.
2026-01-08 16:14:01 +01:00
e4b59b1571 feat(company-explorer): add wikipedia integration, robotics settings, and manual overrides
- Ported robust Wikipedia extraction logic (categories, first paragraph) from legacy system.
- Implemented database-driven Robotics Category configuration with frontend settings UI.
- Updated Robotics Potential analysis to use Chain-of-Thought infrastructure reasoning.
- Added Manual Override features for Wikipedia URL (with locking) and Website URL (with re-scrape trigger).
- Enhanced Inspector UI with Wikipedia profile, category tags, and action buttons.
2026-01-08 16:14:01 +01:00
3590e34490 Notion_Dashboard.md hinzugefügt 2026-01-08 15:12:11 +00:00
c6a37a3c17 feat(company-explorer): Initial Web UI & Backend with Enrichment Flow
This commit introduces the foundational elements for the new "Company Explorer" web application, marking a significant step away from the legacy Google Sheets / CLI system.

Key changes include:
- Project Structure: A new  directory with separate  (FastAPI) and  (React/Vite) components.
- Data Persistence: Migration from Google Sheets to a local SQLite database () using SQLAlchemy.
- Core Utilities: Extraction and cleanup of essential helper functions (LLM wrappers, text utilities) into .
- Backend Services: , ,  for AI-powered analysis, and  logic.
- Frontend UI: Basic React application with company table, import wizard, and dynamic inspector sidebar.
- Docker Integration: Updated  and  for multi-stage builds and sideloading.
- Deployment & Access: Integrated into central Nginx proxy and dashboard, accessible via .

Lessons Learned & Fixed during development:
- Frontend Asset Loading: Addressed issues with Vite's  path and FastAPI's .
- TypeScript Configuration: Added  and .
- Database Schema Evolution: Solved  errors by forcing a new database file and correcting  override.
- Logging: Implemented robust file-based logging ().

This new foundation provides a powerful and maintainable platform for future B2B robotics lead generation.
2026-01-07 17:55:08 +00:00
e27cc995f6 docs(duckdns): Update status and sync to Notion
- Added analysis of latest DNS monitor logs (06.01.2026).

- Refactored sync_docs_to_notion.py to be generic and support multiple files.
2026-01-06 20:40:04 +00:00
4b46dd3935 feat(notion): Add documentation sync script
- Created sync_docs_to_notion.py to parse and upload markdown docs to Notion.
2026-01-06 20:35:03 +00:00
a1e1c777be feat(notion): Initial PoC for Notion Integration
- Added documentation for Notion setup and resources (notion_integration.md).

- Added scripts for authentication test, database creation, and product insertion.

- Successfully tested connection and data mapping for 'RoboPlanet Product Master'.
2026-01-06 20:33:18 +00:00
02b02856f6 feat(gtm): v2.5 - Hard Fact Extraction & UI
- Backend: Implemented secondary extraction phase for structured specs (JSON schema).

- Backend: Added strict normalization rules (min, cm, kg).

- Frontend: Added 'Phase1Data' interface update for specs.

- Frontend: Implemented new UI component for 'Technical Specifications' in Phase 1.

- Frontend: Updated header and sidebar to display 'v2.5' build marker.

- Docs: Updated architectural documentation.
2026-01-06 19:36:42 +00:00
0995d7c43a Docs: Update infrastructure guide with physical DSL line findings.
- Added section on 'Hardware / DSL-Leitung' explaining the detected 17m branch line (Stichleitung) causing signal reflections and timeouts.
- Clarified that 'IP Flapping' was caused by stale caching of the previous day's IP, exacerbated by incorrect DNS settings (8.8.8.8).
- Finalized troubleshooting steps for Synology and FritzBox configuration.
2026-01-06 15:27:58 +00:00
3decb8e908 Docs: Update troubleshooting guide with Synology Network Interface DNS fix.
- Documented the critical finding of hardcoded DNS (8.8.8.8) in Synology Network Interface settings overriding global DSM settings.
- Added comprehensive checklist for Synology, FritzBox, and Client configuration to ensure DNS stability and NAT loopback functionality.
- Updated log analysis section with 'NETWORK_WAIT' and 'ALERT' scenarios.
2026-01-06 15:12:41 +00:00
373304c57f Docs: Add FritzBox Rebind Protection & Client Troubleshooting guides.
- Updated 'duckdns_setup.md' with critical instructions for configuring FritzBox DNS Rebind Protection to enable internal access (NAT Loopback).
- Added steps for clearing client-side DNS cache (Windows).
- Included Cloudflare DNS switch in documentation reflecting recent monitor script changes.
2026-01-06 13:19:32 +00:00
7f8205ffb9 Chore: Remove previously tracked databases and venv from index.
These files are now covered by .gitignore and should not be tracked by Git.
2026-01-06 11:45:17 +00:00
92949c75cb Chore: Update .gitignore to exclude logs, databases, and venv.
- Added 'Log_from_docker/' to ignore runtime logs.
- Added 'diag_venv/' to ignore temporary diagnostic environments.
- Added '*.db' to exclude local SQLite databases from version control.
2026-01-06 11:45:15 +00:00
3c2d7b4744 Fix(DuckDNS): Resolve zombie updater conflict via token rotation.
- Updated 'docker-compose.yml' with new DuckDNS token to lock out rogue updaters (FritzBox/HA).
- Enhanced 'dns-monitor/monitor.sh' to detect 'IP Flapping' (Zombie Updaters) by comparing Public vs. Global vs. Local IPs.
- Updated documentation 'duckdns_setup.md' with troubleshooting steps for IP flapping and zombie updaters.
2026-01-06 11:43:31 +00:00
a05aaae64c Infra: Added robust DuckDNS updater and DNS monitoring sidecar container 2026-01-05 21:44:27 +00:00
c8491ba5ba fix(infra): increase nginx client_max_body_size to 50M; docs: update status 2026-01-05 16:05:10 +00:00
b353cda9aa feat(gtm): add aspect ratio & corporate design; fix(market): harden backend logging & json parsing 2026-01-05 11:42:15 +00:00
1c247b1b63 feat(gtm): add responsive collapsible sidebar for mobile 2026-01-04 19:53:21 +00:00
72cb1d7564 docs: update migration guide with gemini versioning and model availability insights (v2.4) 2026-01-04 19:24:43 +00:00
68b2853d0d feat(gtm): improve phase 5 report rendering & update documentation to v2.3 2026-01-04 18:29:30 +00:00
642a855113 feat(gtm): add session history, database loading, and markdown file import 2026-01-04 17:29:20 +00:00
704a656c40 feat(gtm): upgrade to google-genai, fix image gen & frontend crash 2026-01-04 16:02:23 +00:00
a5bd0b272b Fix: Corrected image response handling in frontend and integrated mandatory Wackler Ecosystem logic into system prompts 2026-01-03 14:37:52 +00:00
3fa4a9d220 Fix: Resolved Phase 5 UI rendering, updated server version to 1.2.0, and fixed critical volume mount path for server.cjs 2026-01-03 14:05:27 +00:00