AI/firecrawl
1
0
Fork 0
mirror of https://git.mirrors.martin98.com/https://github.com/mendableai/firecrawl synced 2025-06-20 22:56:44 +08:00
Code Issues Packages Projects Releases Wiki Activity
3,475 Commits 496 Branches 17 Tags
Commit Graph

3475 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Gergő Móricz
670ca84ae9
fix(v1/checkCredits): snap crawl limit to remaining credits if over without erroring out (#1350) 2025-03-16 19:57:08 +01:00
Gergő Móricz
87ad53e727 fix(api/tests/snips/billing): bump timeout 2025-03-16 16:37:11 +01:00
Eric Ciarla
180770f1a3
init and final (#1349) 2025-03-16 16:16:35 +01:00
Gergő Móricz
bad822421f fix(v1/scrape): make log show up in queries 2025-03-16 16:04:25 +01:00
Gergő Móricz
611c2d9c83 feat(v1/scrape): add further logging to document scrape bugs better 2025-03-16 16:02:53 +01:00
Nicolas
f1206e4870 Nick: urls optional on extract 2025-03-15 22:50:19 -04:00
Gergő Móricz
ca93ba6c6d
fix(js-sdk/crawl,batch-scrape): retry status call if it returns an error up to 3 times (#1343) 2025-03-15 12:42:53 +01:00
rafaelmmiller
cc255d488e fixed websocket params 2025-03-14 18:27:42 -03:00
Ademílson F. Tonato
97695dd55b
refator: dry request and error handling 2025-03-14 19:53:57 +00:00
Eric Ciarla
905885abf9
Merge pull request #1336 from aparupganguly/feature/claude3.7-stock 
Add/ Claude 3.7 implementation
 2025-03-14 09:49:40 -07:00
rafaelmmiller
e7db5a2d5b tomkosms review 2025-03-14 07:49:30 -03:00
rafaelmmiller
86f41460e0 removed v0 in example 2025-03-13 17:00:46 -03:00
Aparup Ganguly
db3faf85f4 Claude 3.7 implementation 2025-03-14 01:15:20 +05:30
rafaelmmiller
3641070ece async 2025-03-13 16:27:59 -03:00
Gergő Móricz
c3ebfafba7
fix(llmExtract): remove unsupported JSON schema properties (#1335) 2025-03-13 20:10:39 +01:00
Gergő Móricz
387dd3aa38 fix(tests/snips/billing): don't wait 40s for nothing when self hosted 2025-03-13 20:07:52 +01:00
Gergő Móricz
c7ae50d2d0
fix(crawler): sitemaps poisoning crawls with unrelated links (#1334) 2025-03-13 19:31:05 +01:00
Dominik Farr
da6b7505f3 Meaningful log message for high resource usage errors 2025-03-13 11:08:04 -07:00
Nicolas
c6cad942ab Nick: errors -> warn 2025-03-13 13:07:51 -04:00
Nicolas
7ec278a908 Nick: fixes 2025-03-13 13:05:12 -04:00
Nicolas
134de67a3b
(fix/map) Map failed to filter by path if indexed (#1333) 
* Nick:

* Update map.ts

* Update map.ts
 2025-03-13 12:48:56 -04:00
Gergő Móricz
f87e11712c fix: don't log bull secret 2025-03-13 17:30:37 +01:00
Loris
c53df8650a
Update searxng.ts (#1319) 
remove default categories. otherwise we cannot use engines
 2025-03-13 17:21:44 +01:00
rafaelmmiller
6a5a4e5b6f improv/types-and-comments-descs 2025-03-13 11:21:35 -03:00
Nicolas
d54af97754 Update rate-limiter.ts 2025-03-12 21:57:50 -04:00
Nicolas
b87b0d9b7f Merge branch 'nsc/concurrent-browsers' 2025-03-12 20:21:26 -04:00
Nicolas
e886189394 Update search.ts 2025-03-12 20:21:19 -04:00
Nicolas
1e6b484add
(feat/pricing) Concurrent Browsers - Improve rate limits (#1331) 
* Update rate-limiter.ts

* Update rate-limiter.ts
 2025-03-12 15:23:09 -04:00
Nicolas
d438b235f6 Update rate-limiter.ts 2025-03-12 15:22:28 -04:00
Gergő Móricz
71b6b83ec2
tally rework api switchover (#1328) 
* tally rework api switchover

* fix and send logs

* temp: force main instance while RPCs propagate

* Revert "temp: force main instance while RPCs propagate"

This reverts commit 4c93379cfa64efd60eb4767dd8eced1bdd302531.
 2025-03-12 20:10:33 +01:00
Nicolas
9edbdc987f Update rate-limiter.ts 2025-03-12 14:17:22 -04:00
Gergő Móricz
7cf2e52fe6
feat(crawl): add maxDiscoveryDepth (#1329) 2025-03-12 18:46:57 +01:00
Gergő Móricz
d855f5a567 fix(test/snips/scrape): allow more time for stealth proxy 2025-03-12 18:22:40 +01:00
Gergő Móricz
97dee5de21 temp(ci/self-host): remove no-proxy option 2025-03-12 18:19:24 +01:00
Gergő Móricz
337bc261f7 temp: remove flakey ad-block tests 2025-03-12 18:17:52 +01:00
Abdul Rahman ArM
e9804d25f9
fix: resolve circular JSON structure error in search function (#1330) 
Modified error handlers to avoid logging entire response objects that contain circular references
 2025-03-12 18:13:53 +01:00
Gergő Móricz
0154e40685 fix(js-sdk/extract): fix zod type check with zod version discrepancy 2025-03-12 16:02:44 +01:00
Nicolas
4cc33e1e8d Nick: added team_id_o 2025-03-10 22:30:26 -04:00
Gergő Móricz
0c457e6f2f adjust acuc balance 2025-03-07 20:34:43 +01:00
rafaelmmiller
3786ad7f5d restart 2025-03-07 16:19:59 -03:00
Nicolas
7ec1437d14 Merge branch 'fix/preview_token' v1.6.0 2025-03-06 19:17:09 -03:00
Nicolas
1ced546bd0 Update rate-limiter.ts 2025-03-06 19:17:02 -03:00
Nicolas
60346ecfa3
Fix/p token (#1305) 
* preview-token

* Nick:

---------

Co-authored-by: rafaelmmiller <150964962+rafaelsideguide@users.noreply.github.com>
 2025-03-06 19:03:33 -03:00
Nicolas
f45b3c0155 Merge branch 'main' into fix/preview_token 2025-03-06 19:02:29 -03:00
Nicolas
b66e0ccb7d Nick: 2025-03-06 18:36:01 -03:00
rafaelmmiller
55a4a3d768 preview-token 2025-03-06 18:16:07 -03:00
Gergő Móricz
39b1390289 fix: crawl 2025-03-06 21:57:42 +01:00
Gergő Móricz
a1e6c13b67 move crawl to read replica 2025-03-06 21:57:42 +01:00
Nicolas
982b3da27d Update auth.ts 2025-03-06 17:53:41 -03:00
Nicolas
5a149a1c30 Revert "fix(auth): always use replica for acuc" 
This reverts commit 57b313608cb6e9f3c123e4754c653fef8dfacbdf.
 2025-03-06 17:53:28 -03:00