AI/firecrawl
1
0
Fork 0
mirror of https://git.mirrors.martin98.com/https://github.com/mendableai/firecrawl synced 2025-06-21 03:24:20 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,938 Commits 496 Branches 17 Tags
Commit Graph

146 Commits

Author SHA1 Message Date
Gergő Móricz
c75522f535
feat(sdk): enforce timeout on client-side if set (#1204) 2025-02-20 13:35:31 +01:00
niazarak
e4504b3236
Use correct list typing for py 3.8 support (#931) 
list[str] is not supported in Python 3.8
 2025-02-20 07:39:46 +01:00
Eric Ciarla
d984b50400
Add llmstxt generator endpoint (#1201) 
* Nick:

* Revert "fix(v1/types): fix extract -> json rename (FIR-1072) (#1195)"

This reverts commit 586a10f40d354a038afc2b67809f20a7a829f8cb.

* Update deep-research-service.ts

* Nick:

* init

* part 2

* Update generate-llmstxt-service.ts

* Fix queue

* Update queue-worker.ts

* Almost there

* Final touches

* Update requests.http

* final touches

* Update requests.http

* Improve logging

* Change endpoint to /llmstxt

* Update queue-worker.ts

* Update generate-llmstxt-service.ts

* Nick: cache

* Update index.ts

* Update firecrawl.py

* Update package.json

---------

Co-authored-by: Nicolas <nicolascamara29@gmail.com>
Co-authored-by: Gergő Móricz <mo.geryy@gmail.com>
 2025-02-19 14:42:33 -03:00
Nicolas
73ecaf74c2
feat(v1/extract) Show sources out of __experimental (#1180) 
* Nick:

* Nick:

* Nick:
 2025-02-13 12:41:45 -03:00
Nicolas
fe276060cf Update pyproject.toml 2025-02-06 12:19:32 -03:00
Gergő Móricz
844ba39f74 fix(sdks): MIT license 2025-02-06 16:07:50 +01:00
Nicolas
492b81d7c3 Nick: origin api-sdk in python sdk 2025-01-31 12:20:41 -03:00
Nicolas
3604f2a3ae Nick: misc improvements 2025-01-21 16:57:45 -03:00
Nicolas
16af54cf2b Nick: bump sdks 2025-01-20 13:43:31 -03:00
Nicolas
ef69b1ac88 Nick: allowExternalLinks is now enableWebSearch 2025-01-20 13:41:30 -03:00
Nicolas
5d62e8264b Nick: 2025-01-18 17:37:11 -03:00
Nicolas
b030a1c5da Nick: extract to json in the sdks as well 2025-01-18 17:23:21 -03:00
Eric Ciarla
6383bf270a Fix python sdk for extract 2025-01-18 17:12:06 -03:00
Eric Ciarla
3363b2d60e Make prompt not required for extract on python sdk 2025-01-18 17:06:28 -03:00
Gergő Móricz
146dc47954 feat(sdk): check crawl/batch scrape errors 2025-01-17 18:06:04 +01:00
Gergő Móricz
805bfa457d fix(python-sdk): add JSON parse error reporting clarity 2025-01-17 16:16:41 +01:00
Nicolas
7918d0e1c9 Nick: bump 1.12.0 2025-01-07 18:20:56 -03:00
Nicolas
b98e289f03 Nick: 2025-01-07 17:49:21 -03:00
Nicolas
a185c05a5c Nick: sdk async and get status 2025-01-07 17:27:40 -03:00
Nicolas
9ec08d7020 Nick: fixed the sdks 2025-01-07 17:20:49 -03:00
Rafael Miller
a54a5dbb45
removed warnings 2025-01-03 17:13:34 -03:00
rafaelmmiller
55dad5ea13 fixed empty data with next causing infinite loop 2025-01-03 13:56:39 -03:00
rafaelmmiller
bafcc008bc [SDK] fixed none and undefined on response 2025-01-03 13:27:00 -03:00
Nicolas
a4b6dfecd1 Nick: v1.8.0 - added /v1/search support 2025-01-02 20:02:07 -03:00
Nicolas
25da20efd2 Nick: e2e 2025-01-02 19:53:54 -03:00
Nicolas
eae393afb5 Nick: fixed js sdk 2025-01-02 19:52:50 -03:00
Nicolas
07a6ba5d91 Nick: 2025-01-02 19:34:37 -03:00
Nicolas
c822e34d37 Nick: fixed extract schema 2025-01-02 14:03:23 -03:00
Nicolas
6851281beb Update __init__.py 2024-12-27 15:46:00 -03:00
Nicolas
cd08be7f37
Merge pull request #990 from RutamBhagat/python-sdk-conditionally-enforce-api-key 
feat(python-sdk): Make API key optional for self-hosted instances
 2024-12-27 15:43:37 -03:00
Nicolas
d1f3e26f9e Nick: blocklist string 2024-12-20 18:09:49 -03:00
RutamBhagat
2b488cac3d chore: remove pytest dependency from pyproject.toml 2024-12-20 01:54:29 -08:00
Nicolas
3e60f175bb Nick: prompt should be optional on /extract sdks 2024-12-19 16:14:49 -03:00
Nicolas
8063474c85 Update __init__.py 2024-12-19 16:14:17 -03:00
Nicolas
525a71d789 Update __init__.py 2024-12-19 16:10:42 -03:00
rafaelmmiller
19246f6289 feat-SDK/added crawl id to ws 2024-12-18 18:36:04 -03:00
RutamBhagat
29cea4c51d feat(python-sdk): improve API key handling for cloud vs self-hosted services in FirecrawlApp 2024-12-17 13:31:35 -08:00
rafaelmmiller
ff878bc6f5 bump version 2024-12-09 14:35:22 -03:00
rafaelmmiller
d8847bb4ce fixes schema warning 2024-12-09 14:34:50 -03:00
rafaelmmiller
7e9ad3cba7 fixed keyerror for data on sdk 2024-12-04 11:17:19 -03:00
rafaelmmiller
781adc21af fixes while next loop 2024-12-03 11:10:19 -03:00
Nicolas
ea1d3d7025 Nick: fix extract python sdk 2024-11-26 19:43:32 -03:00
Nicolas
d02a8bcb82 Nick: extract urls to extract 2024-11-19 13:49:23 -08:00
rafaelmmiller
41b45a844b sdk allowexternallinks 2024-11-14 15:56:12 -03:00
rafaelmmiller
80d6cb16fb sdks wip 2024-11-14 15:51:27 -03:00
Nicolas
9688bad60d
Update __init__.py 2024-11-11 14:48:11 -05:00
rafaelmmiller
27c5a93f4e added next handler for python sdk (js is ok) 2024-11-08 15:39:38 -03:00
Dmitriy Vasilyuk
2fa25cb992
[Fix] Prevent Python Firecrawl logger from interfering with loggers in client applications (#613) 
* Prevent firecrawl logger from interfering with other loggers

* Always check if logger has handlers

---------

Co-authored-by: Gergő Móricz <mo.geryy@gmail.com>
 2024-11-05 08:33:39 +01:00
Nicolas
8a4f4cb9d9
Update README.md 2024-10-26 16:10:51 -03:00
Nicolas
f0054da934 Nick: lgtm 2024-10-23 16:06:08 -03:00