mirror of
https://git-proxy.hk.martin98.com/https://github.com/mendableai/firecrawl
synced 2025-04-10 13:52:42 +08:00
5e5b5ee0e2
* agent that decides if splits schema or not * split and merge properties done * wip * wip * changes * ch * array merge working! * comment * wip * dereferentiate schema * dereference schemas * Nick: new re-ranker * Create llm-links.txt * Nick: format * Update extraction-service.ts * wip: cooking schema mix and spread functions * wip * wip getting there!!! * nick: * moved functions to helpers * nick: * cant reproduce the error anymore * error handling all scrapes failed * fix * Nick: added the sitemap index * Update sitemap-index.ts * Update map.ts * deduplicate and merge arrays * added error handler for object transformations * Update url-processor.ts * Nick: * Nick: fixes * Nick: big improvements to rerank of multi-entity * Nick: working * Update reranker.ts * fixed transformations for nested objs * fix merge nulls * Nick: fixed error piping * Update queue-worker.ts * Update extraction-service.ts * Nick: format * Update queue-worker.ts * Update pnpm-lock.yaml * Update queue-worker.ts --------- Co-authored-by: rafaelmmiller <150964962+rafaelsideguide@users.noreply.github.com> Co-authored-by: Thomas Kosmas <thomas510111@gmail.com>
42 lines
750 B
Plaintext
42 lines
750 B
Plaintext
.DS_Store
|
|
/node_modules/
|
|
/dist/
|
|
.env
|
|
*.csv
|
|
dump.rdb
|
|
/mongo-data
|
|
apps/js-sdk/node_modules/
|
|
|
|
apps/api/.env.local
|
|
|
|
apps/test-suite/node_modules/
|
|
|
|
|
|
apps/test-suite/.env
|
|
apps/test-suite/logs
|
|
apps/test-suite/load-test-results/test-run-report.json
|
|
|
|
apps/playwright-service-ts/node_modules/
|
|
apps/playwright-service-ts/package-lock.json
|
|
|
|
|
|
/examples/o1_web_crawler/venv
|
|
*.pyc
|
|
.rdb
|
|
|
|
apps/js-sdk/firecrawl/dist
|
|
|
|
/examples/o1_web_crawler/firecrawl_env
|
|
/examples/crm_lead_enrichment/crm_lead_enrichment_env
|
|
/.venv
|
|
/examples/claude_web_crawler/firecrawl_env
|
|
/examples/haiku_web_crawler/firecrawl_env
|
|
/examples/sonnet_web_crawler/firecrawl_env
|
|
/examples/internal_link_assitant/firecrawl_env
|
|
|
|
/apps/api/logs/*
|
|
/apps/api/debug/*
|
|
|
|
.vscode
|
|
llm-links.txt
|
|
mapped-links.txt |