AI/firecrawl
1
0
Fork 0
mirror of https://git.mirrors.martin98.com/https://github.com/mendableai/firecrawl synced 2025-06-04 11:24:40 +08:00
Code Issues Packages Projects Releases Wiki Activity
3,475 Commits 496 Branches 17 Tags
Commit Graph

3475 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Nicolas
8eb4e1a96a Update firecrawl.py 2025-04-17 23:50:56 -07:00
rafaelmmiller
23ef26655c params 2025-04-17 23:37:45 -07:00
rafaelmmiller
22cfdd6ae3 added agent options types 2025-04-17 23:31:28 -07:00
Nicolas
f48937a55d Update firecrawl.py 2025-04-17 23:17:00 -07:00
Nicolas
d9780412f5 Update firecrawl.py 2025-04-17 23:08:33 -07:00
Nicolas
c67425ad8b Merge branch 'main' into sdk-improv/async 2025-04-17 22:59:07 -07:00
Gergő Móricz
ec3d679c5b feat(rust-sdk): add agent options 2025-04-17 22:15:13 -07:00
kkharji
f2c01340d1
feat(rust): update rust sdk to support new features (#1446) 
* chore(rust-sdk): cargo fmt

* feat(rust-sdk): implement search api + example + test

* feat(rust-sdk): implement crawl cancel api + example + test

* feat(rust-sdk): implement crawl check errors api + example + test

* feat(rust-sdk): implement batch crawl + test + example

+ Fix MapOptions

* feat(rust-sdk): implement extract api + test + example

* feat(rust-sdk): implement llmtxt api + test + example

* chore(rust-sdk): correct mock tests

* chore(rust-sdk): prep for cargo distribution
 2025-04-18 06:59:59 +02:00
Gergő Móricz
33aece8e96 more cost calc 2025-04-17 14:00:48 -07:00
Gergő Móricz
9bea877eb1
feat(extract): cost limit (#1473) 2025-04-17 21:44:28 +02:00
Gergő Móricz
7df557e59c feat(cost-tracking): add model tracking and more costs 2025-04-17 11:33:10 -07:00
Nicolas
5aa9469081 Update __init__.py 2025-04-17 11:14:09 -07:00
Gergő Móricz
f844b329f1 remove agent preview rate limiter 2025-04-17 11:04:45 -07:00
Gergő Móricz
06770bc63f fix(scrape/json): move back to 4o mini 2025-04-17 10:48:13 -07:00
Gergő Móricz
8546bcacc0 new cost tracking 2025-04-17 09:23:53 -07:00
Gergő Móricz
ba4df67de7 force 2.5 2025-04-16 16:53:04 -07:00
Gergő Móricz
6a93293fd0 feat(smart-scrape): use correct models for multi-entity assembly 2025-04-16 16:39:48 -07:00
Gergő Móricz
751c30f139 feat(extractSmartScrape): better pagination handling 2025-04-16 16:23:12 -07:00
Gergő Móricz
509e6e658c feat(llmExtract): more logging 2025-04-16 15:40:07 -07:00
Gergő Móricz
4c5120e081 feat(llm-extract): do more logging, even more 2025-04-16 15:10:17 -07:00
Gergő Móricz
b45e3bda13 better logs 2025-04-16 15:08:05 -07:00
Gergő Móricz
ad7e3f62d1 feat(extractSmartScrape): resolve refs in provided schema 2025-04-16 14:32:00 -07:00
Gergő Móricz
5ee2434c9d more logs 2025-04-16 14:24:09 -07:00
Gergő Móricz
772a3ea751 Bump the SDK 2025-04-16 12:36:43 -07:00
Gergő Móricz
4740254b89 feat(rquests.http): add extract 2025-04-16 12:32:02 -07:00
Gergő Móricz
c713251261 feat(extraction-service): send thisSessionId for single entity 2025-04-16 12:28:35 -07:00
Gergő Móricz
7787a58beb default timeout 2025-04-16 10:48:03 -07:00
Gergő Móricz
39d10dc734 feat: disable cost tracking 2025-04-16 09:55:32 -07:00
Gergő Móricz
8766bc6f6b temp: don't... do that 2025-04-16 03:28:33 -07:00
Gergő Móricz
defc80af32 stream session IDs for single URLs 2025-04-16 03:23:18 -07:00
Gergő Móricz
d82f44c93e feat(extract): log failed extracts 2025-04-16 03:13:02 -07:00
Gergő Móricz
aa20246571 minor cost tracking fix 2025-04-16 02:06:39 -07:00
Nicolas
51967c7c3d Merge branch 'main' into rafa/sessionIdsExtract 2025-04-16 01:48:13 -07:00
Gergő Móricz
dcef6fbc13 feat(extractSmartScrape): mog it to 100 pages max 2025-04-16 01:13:49 -07:00
Gergő Móricz
129b10e478 fix(llmExtract): cost calculation 2025-04-16 01:04:48 -07:00
rafaelmmiller
f92217e3b6 wip 2025-04-16 00:38:35 -07:00
Gergő Móricz
0d813b628b feat: correlate smart scrape 2025-04-16 00:25:42 -07:00
Gergő Móricz
edd4c30908 FIX IT 2025-04-16 00:11:27 -07:00
Gergő Móricz
a06910115b asd 2025-04-16 00:03:07 -07:00
Gergő Móricz
2245650bc3 fix 2025-04-15 23:54:56 -07:00
Gergő Móricz
2193bee133 Improve logging 2025-04-15 23:52:20 -07:00
Gergő Móricz
0935ec210e feat(smartScrape): better loggin 2025-04-15 23:34:00 -07:00
Gergő Móricz
b6abe4f26b fix(smartScrape): pass extract id 2025-04-15 23:23:18 -07:00
Gergő Móricz
80b507e64e correlate with eid 2025-04-15 23:06:13 -07:00
Gergő Móricz
512a2b1cd4 feat(extract): run on original links if reranker is weird 2025-04-15 22:57:20 -07:00
Gergő Móricz
13bd50ad2b feat(fetch): don't time out (for smart scrape) 2025-04-15 21:57:05 -07:00
Gergő Móricz
0abe60085b fix 2025-04-15 20:29:01 -07:00
Gergő Móricz
eea1267b50 feat(batchExtract): thingymajig 2025-04-15 20:28:53 -07:00
Gergő Móricz
d119552eee bump rate limits 2025-04-15 20:20:29 -07:00
Gergő Móricz
5515ca7a52 fix(llm-cost): update 2025-04-15 19:49:14 -07:00