AI/firecrawl
1
0
Fork 0
mirror of https://git.mirrors.martin98.com/https://github.com/mendableai/firecrawl synced 2025-08-06 08:26:05 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,599 Commits 496 Branches 17 Tags
Commit Graph

2599 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Nicolas
a185c05a5c Nick: sdk async and get status 2025-01-07 17:27:40 -03:00
Nicolas
9ec08d7020 Nick: fixed the sdks 2025-01-07 17:20:49 -03:00
Nicolas
dd14744850 Update types.ts 2025-01-07 16:55:55 -03:00
Nicolas
9fdcfb9314 Update index.ts 2025-01-07 16:24:46 -03:00
Nicolas
51636352a6 Merge branch 'nsc/extract-queue' of https://github.com/mendableai/firecrawl into nsc/extract-queue 2025-01-07 16:21:58 -03:00
Nicolas
11af214db1 Nick: update extract in case there is an error 2025-01-07 16:21:51 -03:00
Gergő Móricz
1f2a76fc23
Update apps/api/src/lib/extract/extraction-service.ts 2025-01-07 20:18:10 +01:00
Nicolas
eb254547e5 Nick: 2025-01-07 16:16:01 -03:00
Nicolas
86e34d7c6c Nick: wip 2025-01-07 12:13:12 -03:00
Nicolas
bb27594443 Merge branch 'main' into nsc/extract-queue 2025-01-06 13:01:15 -03:00
Nicolas
b82cfa8540
Merge pull request #1038 from 1101-1/add_actual_random_useragent 
feat: use new random user agent instead of the old one
 2025-01-06 11:51:15 -03:00
Kirill
736c3675b6 use new agent generation instead of expired one 2025-01-05 17:07:14 +04:00
Nicolas
ceb2104960
Merge pull request #1034 from mendableai/sdk/fixed-none-undefined-on-response 
[SDK] fixed none and undefined on response
 2025-01-04 16:31:41 -03:00
Gergő Móricz
461842fe8c fix(v1/crawl-status): handle job's returnvalue being explicitly null (db race) 2025-01-04 17:24:33 +01:00
Gergő Móricz
b92a4eb79b fix(queue-worker): only do redirect handling logic on crawls, not batch scrape 2025-01-04 16:59:35 +01:00
Nicolas
d48ddb8820 Update canonical-url.test.ts 2025-01-03 23:55:05 -03:00
Nicolas
f2e0bfbfe3 Nick: url normalization 2025-01-03 23:54:03 -03:00
Nicolas
f25c0c6d21 Nick: added canonical tests 2025-01-03 23:16:33 -03:00
Nicolas
aef040b41e Nick: from cache fixes 2025-01-03 23:07:15 -03:00
Nicolas
e8a9d8ddcd Merge branch 'main' of https://github.com/mendableai/firecrawl 2025-01-03 22:55:42 -03:00
Nicolas
05e845a971 Update cache.ts 2025-01-03 22:55:38 -03:00
Nicolas
6bfdbcdba9
Merge pull request #1037 from mendableai/nsc/semantic-index-extract 
WIP Indexes, Caching for /extract, Improvements
 2025-01-03 22:52:22 -03:00
Nicolas
c655c6859f Nick: fixed 2025-01-03 22:50:53 -03:00
Nicolas
a4f7c38834 Nick: fixed 2025-01-03 22:15:23 -03:00
Nicolas
8df1c67961 Update queue-worker.ts 2025-01-03 21:48:28 -03:00
Nicolas
499479c85e Update url-processor.ts 2025-01-03 21:28:52 -03:00
Nicolas
432b410678 Update queue-worker.ts 2025-01-03 21:26:05 -03:00
Nicolas
6b2e1cbb28 Nick: cache /extract scrapes 2025-01-03 21:19:40 -03:00
Nicolas
27457ed5db Nick: init 2025-01-03 20:44:27 -03:00
Nicolas
81cf05885b Merge branch 'main' into nsc/semantic-index-extract 2025-01-03 19:57:29 -03:00
Rafael Miller
a54a5dbb45
removed warnings 2025-01-03 17:13:34 -03:00
Rafael Miller
12cd9f083c
removed warnings 2025-01-03 17:12:30 -03:00
rafaelmmiller
b223f6ae68 Merge branch 'sdk/fixed-none-undefined-on-response' of https://github.com/mendableai/firecrawl into sdk/fixed-none-undefined-on-response 2025-01-03 13:56:46 -03:00
rafaelmmiller
55dad5ea13 fixed empty data with next causing infinite loop 2025-01-03 13:56:39 -03:00
Rafael Miller
2e53eb98ce
Merge branch 'main' into sdk/fixed-none-undefined-on-response 2025-01-03 13:27:52 -03:00
rafaelmmiller
bafcc008bc [SDK] fixed none and undefined on response 2025-01-03 13:27:00 -03:00
Nicolas
87757d9b8e Nick: fixed schemas on extract for node 2025-01-03 13:19:08 -03:00
Nicolas
ad49503f8a Update search.ts 2025-01-02 21:15:47 -03:00
Nicolas
cbe0716439 Update search.ts 2025-01-02 21:13:24 -03:00
Nicolas
e37ab8431a Update search.ts 2025-01-02 21:07:14 -03:00
Nicolas
8b64e915b3 Update search.ts 2025-01-02 21:02:55 -03:00
Nicolas
7ce780ac81 Update search.ts 2025-01-02 20:40:38 -03:00
Nicolas
b244afbc82 Update README.md 2025-01-02 20:26:51 -03:00
Nicolas
a4b6dfecd1 Nick: v1.8.0 - added /v1/search support v1.2.0 2025-01-02 20:02:07 -03:00
Nicolas
b61a1ccfd3
Merge pull request #1032 from mendableai/nsc/v1-search 
(feat/v1) Search
 2025-01-02 19:58:44 -03:00
Nicolas
21bf89b6cc Update search.ts 2025-01-02 19:57:51 -03:00
Nicolas
22ae1730bd Update search.ts 2025-01-02 19:57:41 -03:00
Nicolas
a0dbf20c40 Update types.ts 2025-01-02 19:55:28 -03:00
Nicolas
25da20efd2 Nick: e2e 2025-01-02 19:53:54 -03:00
Nicolas
eae393afb5 Nick: fixed js sdk 2025-01-02 19:52:50 -03:00