AI/firecrawl
1
0
Fork 0
mirror of https://git.mirrors.martin98.com/https://github.com/mendableai/firecrawl synced 2025-06-04 11:24:40 +08:00
Code Issues Packages Projects Releases Wiki Activity
3,475 Commits 496 Branches 17 Tags
Commit Graph

2223 Commits

Author SHA1 Message Date
Gergő Móricz
8b82e11625 Decrease diff warn threshold further 2025-04-24 14:12:52 +02:00
Gergő Móricz
e4f9a92e98 adjust diff warn threshold 2025-04-23 23:54:46 +02:00
Gergő Móricz
0e7f2c8599 feat(diff): log if it takes a long time with params 2025-04-23 20:46:51 +02:00
Rafael Miller
37dabce1ed
[feat] added second scrapeURLWithFireEngine (#1494) 2025-04-23 20:36:36 +02:00
Gergő Móricz
9435c800c0 fix(api/tests/scrape): don't test scrape status endpoint on self-host env 2025-04-23 20:36:22 +02:00
Nicolas
2f6520bc38 Merge branch 'main' of https://github.com/mendableai/firecrawl 2025-04-23 14:19:26 -04:00
Nicolas
22f7efed35 NIck: rm scrape events 2025-04-23 14:19:25 -04:00
Nicolas
1c421f2d74
Nick: (#1492) 2025-04-22 21:42:37 -04:00
Nicolas
e532a96b0c
(fix/search) Search logs fix (#1491) 
* Update search.ts

* Update search.ts
 2025-04-22 17:12:10 -04:00
Gergő Móricz
1a02ef56e6 fix(extract/fire-1): thinking tokens pricing 2025-04-22 01:00:00 +02:00
Gergő Móricz
f47d8779f5 fix(extract/oldExtract): do if for old/new extract 2025-04-22 00:53:17 +02:00
Gergő Móricz
df305c2a97 fix(): null-proof/nan-proof 2025-04-19 12:35:55 -07:00
Gergő Móricz
0e027fe430 fix(scrape): bill llm on fail 2025-04-19 02:56:18 -07:00
Gergő Móricz
b35462456e billing for smart scrape 2025-04-19 02:06:30 -07:00
Gergő Móricz
0a86d2738f reenable 2025-04-19 01:57:58 -07:00
Gergő Móricz
324b4e2e1e fix rounding 2025-04-19 01:45:36 -07:00
Gergő Móricz
6d2347b5f8 feat(llmExtract): add token tracking to all calls 2025-04-19 01:38:55 -07:00
Gergő Móricz
438ea19f16 feat(extract): add thinking tokens 2025-04-19 01:35:17 -07:00
Gergő Móricz
653a0207c3 fix(calculateCost): accuracy 2.5 2025-04-19 01:10:32 -07:00
Gergő Móricz
2b2e648d41 feat(smart-scrape): log failed costs 2025-04-19 01:07:00 -07:00
Gergő Móricz
3909b6641d temp: 2025-04-19 00:19:25 -07:00
Gergő Móricz
5453bed58e temp: put everything back 2025-04-19 00:13:20 -07:00
Gergő Móricz
f451b71308 fix acuc extract preview 2025-04-18 12:37:41 -07:00
Gergő Móricz
3caeaae074 fix(scrapeURL/llmExtract): fix schema-less JSON mode 2025-04-18 10:25:32 -07:00
Nicolas
c69acdffd8 Update v1.ts 2025-04-18 01:57:03 -07:00
Rafael Miller
29b36c5f9a
[python-SDK] improvs/async (#1337) 
* improv/types-and-comments-descs

* async

* removed v0 in example

* tomkosms review

* refator: dry request and error handling

* fixed websocket params

* added origin to requests

* Update firecrawl.py

* Update firecrawl.py

* added agent options types

* Update firecrawl.py

* generic

* Update firecrawl.py

* scrape params commentary

* Update firecrawl.py

* Update firecrawl.py

* Update firecrawl.py

* Update firecrawl.py

* async scrape

* Update firecrawl.py

* Nick: new examples

* Nick: python sdk 2.0

* async functions

* Nick:

* Nick:

---------

Co-authored-by: Ademílson F. Tonato <ademilsonft@outlook.com>
Co-authored-by: Nicolas <nicolascamara29@gmail.com>
 2025-04-18 01:32:55 -07:00
Gergő Móricz
33aece8e96 more cost calc 2025-04-17 14:00:48 -07:00
Gergő Móricz
9bea877eb1
feat(extract): cost limit (#1473) 2025-04-17 21:44:28 +02:00
Gergő Móricz
7df557e59c feat(cost-tracking): add model tracking and more costs 2025-04-17 11:33:10 -07:00
Gergő Móricz
f844b329f1 remove agent preview rate limiter 2025-04-17 11:04:45 -07:00
Gergő Móricz
06770bc63f fix(scrape/json): move back to 4o mini 2025-04-17 10:48:13 -07:00
Gergő Móricz
8546bcacc0 new cost tracking 2025-04-17 09:23:53 -07:00
Gergő Móricz
ba4df67de7 force 2.5 2025-04-16 16:53:04 -07:00
Gergő Móricz
6a93293fd0 feat(smart-scrape): use correct models for multi-entity assembly 2025-04-16 16:39:48 -07:00
Gergő Móricz
751c30f139 feat(extractSmartScrape): better pagination handling 2025-04-16 16:23:12 -07:00
Gergő Móricz
509e6e658c feat(llmExtract): more logging 2025-04-16 15:40:07 -07:00
Gergő Móricz
4c5120e081 feat(llm-extract): do more logging, even more 2025-04-16 15:10:17 -07:00
Gergő Móricz
b45e3bda13 better logs 2025-04-16 15:08:05 -07:00
Gergő Móricz
ad7e3f62d1 feat(extractSmartScrape): resolve refs in provided schema 2025-04-16 14:32:00 -07:00
Gergő Móricz
5ee2434c9d more logs 2025-04-16 14:24:09 -07:00
Gergő Móricz
4740254b89 feat(rquests.http): add extract 2025-04-16 12:32:02 -07:00
Gergő Móricz
c713251261 feat(extraction-service): send thisSessionId for single entity 2025-04-16 12:28:35 -07:00
Gergő Móricz
7787a58beb default timeout 2025-04-16 10:48:03 -07:00
Gergő Móricz
39d10dc734 feat: disable cost tracking 2025-04-16 09:55:32 -07:00
Gergő Móricz
8766bc6f6b temp: don't... do that 2025-04-16 03:28:33 -07:00
Gergő Móricz
defc80af32 stream session IDs for single URLs 2025-04-16 03:23:18 -07:00
Gergő Móricz
d82f44c93e feat(extract): log failed extracts 2025-04-16 03:13:02 -07:00
Gergő Móricz
aa20246571 minor cost tracking fix 2025-04-16 02:06:39 -07:00
Nicolas
51967c7c3d Merge branch 'main' into rafa/sessionIdsExtract 2025-04-16 01:48:13 -07:00
Gergő Móricz
dcef6fbc13 feat(extractSmartScrape): mog it to 100 pages max 2025-04-16 01:13:49 -07:00