2697 Commits

Author	SHA1	Message	Date
Nicolas	0b62be5874	Update firecrawl.py	2025-04-18 01:12:24 -07:00
rafaelmmiller	5db76992de	Merge branch 'sdk-improv/async' of https://github.com/mendableai/firecrawl into sdk-improv/async	2025-04-18 01:07:30 -07:00
rafaelmmiller	8cd82b5600	async scrape	2025-04-18 01:06:58 -07:00
Nicolas	1aa0c092e0	Update firecrawl.py	2025-04-18 01:01:01 -07:00
Nicolas	390f3d44a3	Update firecrawl.py	2025-04-18 00:51:06 -07:00
Nicolas	d8792d2301	Update firecrawl.py	2025-04-18 00:48:07 -07:00
Nicolas	5e6e41ab17	Update firecrawl.py	2025-04-18 00:37:34 -07:00
rafaelmmiller	a655d24e7c	scrape params commentary	2025-04-18 00:29:20 -07:00
Nicolas	8c5509cbb4	Update firecrawl.py	2025-04-18 00:26:00 -07:00
rafaelmmiller	b67bc707d5	Merge branch 'sdk-improv/async' of https://github.com/mendableai/firecrawl into sdk-improv/async	2025-04-18 00:00:21 -07:00
rafaelmmiller	85247991bc	generic	2025-04-18 00:00:18 -07:00
Nicolas	287032017b	Merge branch 'sdk-improv/async' of https://github.com/mendableai/firecrawl into sdk-improv/async	2025-04-17 23:50:57 -07:00
Nicolas	8eb4e1a96a	Update firecrawl.py	2025-04-17 23:50:56 -07:00
rafaelmmiller	23ef26655c	params	2025-04-17 23:37:45 -07:00
rafaelmmiller	22cfdd6ae3	added agent options types	2025-04-17 23:31:28 -07:00
Nicolas	f48937a55d	Update firecrawl.py	2025-04-17 23:17:00 -07:00
Nicolas	d9780412f5	Update firecrawl.py	2025-04-17 23:08:33 -07:00
Nicolas	c67425ad8b	Merge branch 'main' into sdk-improv/async	2025-04-17 22:59:07 -07:00
Gergő Móricz	ec3d679c5b	feat(rust-sdk): add agent options	2025-04-17 22:15:13 -07:00
kkharji	f2c01340d1	feat(rust): update rust sdk to support new features (#1446) ... * chore(rust-sdk): cargo fmt * feat(rust-sdk): implement search api + example + test * feat(rust-sdk): implement crawl cancel api + example + test * feat(rust-sdk): implement crawl check errors api + example + test * feat(rust-sdk): implement batch crawl + test + example + Fix MapOptions * feat(rust-sdk): implement extract api + test + example * feat(rust-sdk): implement llmtxt api + test + example * chore(rust-sdk): correct mock tests * chore(rust-sdk): prep for cargo distribution	2025-04-18 06:59:59 +02:00
Gergő Móricz	33aece8e96	more cost calc	2025-04-17 14:00:48 -07:00
Gergő Móricz	9bea877eb1	feat(extract): cost limit (#1473)	2025-04-17 21:44:28 +02:00
Gergő Móricz	7df557e59c	feat(cost-tracking): add model tracking and more costs	2025-04-17 11:33:10 -07:00
Nicolas	5aa9469081	Update __init__.py	2025-04-17 11:14:09 -07:00
Gergő Móricz	f844b329f1	remove agent preview rate limiter	2025-04-17 11:04:45 -07:00
Gergő Móricz	06770bc63f	fix(scrape/json): move back to 4o mini	2025-04-17 10:48:13 -07:00
Gergő Móricz	8546bcacc0	new cost tracking	2025-04-17 09:23:53 -07:00
Gergő Móricz	ba4df67de7	force 2.5	2025-04-16 16:53:04 -07:00
Gergő Móricz	6a93293fd0	feat(smart-scrape): use correct models for multi-entity assembly	2025-04-16 16:39:48 -07:00
Gergő Móricz	751c30f139	feat(extractSmartScrape): better pagination handling	2025-04-16 16:23:12 -07:00
Gergő Móricz	509e6e658c	feat(llmExtract): more logging	2025-04-16 15:40:07 -07:00
Gergő Móricz	4c5120e081	feat(llm-extract): do more logging, even more	2025-04-16 15:10:17 -07:00
Gergő Móricz	b45e3bda13	better logs	2025-04-16 15:08:05 -07:00
Gergő Móricz	ad7e3f62d1	feat(extractSmartScrape): resolve refs in provided schema	2025-04-16 14:32:00 -07:00
Gergő Móricz	5ee2434c9d	more logs	2025-04-16 14:24:09 -07:00
Gergő Móricz	772a3ea751	Bump the SDK	2025-04-16 12:36:43 -07:00
Gergő Móricz	4740254b89	feat(rquests.http): add extract	2025-04-16 12:32:02 -07:00
Gergő Móricz	c713251261	feat(extraction-service): send thisSessionId for single entity	2025-04-16 12:28:35 -07:00
Gergő Móricz	7787a58beb	default timeout	2025-04-16 10:48:03 -07:00
Gergő Móricz	39d10dc734	feat: disable cost tracking	2025-04-16 09:55:32 -07:00
Gergő Móricz	8766bc6f6b	temp: don't... do that	2025-04-16 03:28:33 -07:00
Gergő Móricz	defc80af32	stream session IDs for single URLs	2025-04-16 03:23:18 -07:00
Gergő Móricz	d82f44c93e	feat(extract): log failed extracts	2025-04-16 03:13:02 -07:00
Gergő Móricz	aa20246571	minor cost tracking fix	2025-04-16 02:06:39 -07:00
Nicolas	51967c7c3d	Merge branch 'main' into rafa/sessionIdsExtract	2025-04-16 01:48:13 -07:00
Gergő Móricz	dcef6fbc13	feat(extractSmartScrape): mog it to 100 pages max	2025-04-16 01:13:49 -07:00
Gergő Móricz	129b10e478	fix(llmExtract): cost calculation	2025-04-16 01:04:48 -07:00
rafaelmmiller	f92217e3b6	wip	2025-04-16 00:38:35 -07:00
Gergő Móricz	0d813b628b	feat: correlate smart scrape	2025-04-16 00:25:42 -07:00
Gergő Móricz	edd4c30908	FIX IT	2025-04-16 00:11:27 -07:00