Nicolas
a74b2dc59f
Nick: json config instead of extract config
2025-04-18 01:54:15 -07:00
Nicolas
06c54bc41c
Update __init__.py
2025-04-18 01:43:18 -07:00
Nicolas
9e67d7ba22
Nick:
2025-04-18 01:30:40 -07:00
Nicolas
37e076e151
Merge branch 'sdk-improv/async' of https://github.com/mendableai/firecrawl into sdk-improv/async
2025-04-18 01:28:39 -07:00
Nicolas
9ba1ae9ae1
Nick:
2025-04-18 01:28:31 -07:00
rafaelmmiller
55c04d615e
Merge branch 'sdk-improv/async' of https://github.com/mendableai/firecrawl into sdk-improv/async
2025-04-18 01:21:29 -07:00
rafaelmmiller
0915db515c
async functions
2025-04-18 01:20:16 -07:00
Nicolas
a3f3168212
Nick: python sdk 2.0
2025-04-18 01:15:14 -07:00
Nicolas
f3522666db
Nick: new examples
2025-04-18 01:13:53 -07:00
Nicolas
0001d6ea25
Merge branch 'sdk-improv/async' of https://github.com/mendableai/firecrawl into sdk-improv/async
2025-04-18 01:12:31 -07:00
Nicolas
0b62be5874
Update firecrawl.py
2025-04-18 01:12:24 -07:00
rafaelmmiller
5db76992de
Merge branch 'sdk-improv/async' of https://github.com/mendableai/firecrawl into sdk-improv/async
2025-04-18 01:07:30 -07:00
rafaelmmiller
8cd82b5600
async scrape
2025-04-18 01:06:58 -07:00
Nicolas
1aa0c092e0
Update firecrawl.py
2025-04-18 01:01:01 -07:00
Nicolas
390f3d44a3
Update firecrawl.py
2025-04-18 00:51:06 -07:00
Nicolas
d8792d2301
Update firecrawl.py
2025-04-18 00:48:07 -07:00
Nicolas
5e6e41ab17
Update firecrawl.py
2025-04-18 00:37:34 -07:00
rafaelmmiller
a655d24e7c
scrape params commentary
2025-04-18 00:29:20 -07:00
Nicolas
8c5509cbb4
Update firecrawl.py
2025-04-18 00:26:00 -07:00
rafaelmmiller
b67bc707d5
Merge branch 'sdk-improv/async' of https://github.com/mendableai/firecrawl into sdk-improv/async
2025-04-18 00:00:21 -07:00
rafaelmmiller
85247991bc
generic
2025-04-18 00:00:18 -07:00
Nicolas
287032017b
Merge branch 'sdk-improv/async' of https://github.com/mendableai/firecrawl into sdk-improv/async
2025-04-17 23:50:57 -07:00
Nicolas
8eb4e1a96a
Update firecrawl.py
2025-04-17 23:50:56 -07:00
rafaelmmiller
23ef26655c
params
2025-04-17 23:37:45 -07:00
rafaelmmiller
22cfdd6ae3
added agent options types
2025-04-17 23:31:28 -07:00
Nicolas
f48937a55d
Update firecrawl.py
2025-04-17 23:17:00 -07:00
Nicolas
d9780412f5
Update firecrawl.py
2025-04-17 23:08:33 -07:00
Nicolas
c67425ad8b
Merge branch 'main' into sdk-improv/async
2025-04-17 22:59:07 -07:00
Nicolas
5aa9469081
Update __init__.py
2025-04-17 11:14:09 -07:00
Nicolas
6634d236bf
(feat/fire-1) FIRE-1 ( #1462 )
...
* wip
* integrating smart-scrape
* integrate smartscrape into llmExtract
* wip
* smart scrape multiple links
* fixes
* fix
* wip
* it worked!
* wip. there's a bug on the batchExtract TypeError: Converting circular structure to JSON
* wip
* retry model
* retry models
* feat/scrape+json+extract interfaces ready
* vertex -> googleapi
* fix/transformArrayToObject. required params on schema is still a bug
* change model
* o3-mini -> gemini
* Update extractSmartScrape.ts
* sessionId
* sessionId
* Nick: f-0 start
* Update extraction-service-f0.ts
* Update types.ts
* Nick:
* Update queue-worker.ts
* Nick: new interface
* rename analyzeSchemaAndPrompt -> F0
* refactor: rename agent ID to model in types and extract logic
* agent
* id->model
* id->model
* refactor: standardize agent model handling and validation across extraction logic
* livecast agent
* (feat/f1) sdks (#1459 )
* feat: add FIRE-1 agent support to Python and JavaScript SDKs
Co-Authored-By: hello@sideguide.dev <hello@sideguide.dev>
* feat: add FIRE-1 agent support to scrape methods in both SDKs
Co-Authored-By: hello@sideguide.dev <hello@sideguide.dev>
* feat: add prompt and sessionId to AgentOptions interface
Co-Authored-By: hello@sideguide.dev <hello@sideguide.dev>
* Update index.ts
---------
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: hello@sideguide.dev <hello@sideguide.dev>
Co-authored-by: Nicolas <nicolascamara29@gmail.com>
* feat(v1): rate limits
* Update types.ts
* Update llmExtract.ts
* add cost tracking
* remove
* Update requests.http
* fix smart scrape cost calc
* log sm cost
* fix counts
* fix
* expose cost tracking
* models fix
* temp: skipLibcheck
* get rid of it
* fix ts
* dont skip lib check
* Update extractSmartScrape.ts
* Update queue-worker.ts
* Update smartScrape.ts
* Update requests.http
* fix(rate-limiter):
* types: fire-1 refine
* bill 150
* fix credits used on crawl
* ban from crawl
* route cost limit warning
* Update generic-ai.ts
* genres
* Update llmExtract.ts
* test server diff
* cletu
---------
Co-authored-by: rafaelmmiller <150964962+rafaelsideguide@users.noreply.github.com>
Co-authored-by: Thomas Kosmas <thomas510111@gmail.com>
Co-authored-by: Ademílson F. Tonato <ademilsonft@outlook.com>
Co-authored-by: devin-ai-integration[bot] <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: hello@sideguide.dev <hello@sideguide.dev>
Co-authored-by: Gergő Móricz <mo.geryy@gmail.com>
2025-04-15 00:19:45 -07:00
devin-ai-integration[bot]
ef341399f0
Add change tracking support to Python and JS SDKs ( #1448 )
...
* Add change tracking support to Python and JS SDKs
Co-Authored-By: Nicolas Camara <nick@sideguide.dev>
* Replace test API keys with TEST_API_KEY placeholder
Co-Authored-By: Nicolas Camara <nick@sideguide.dev>
* Replace API keys with dummy values for testing
Co-Authored-By: Nicolas Camara <nick@sideguide.dev>
* Use environment variables for API keys in tests
Co-Authored-By: Nicolas Camara <nick@sideguide.dev>
* Move JS SDK test to correct location and add dependencies
Co-Authored-By: Nicolas Camara <nick@sideguide.dev>
* Remove old test file location
Co-Authored-By: Nicolas Camara <nick@sideguide.dev>
* Update test file to use TEST_API_KEY environment variable
Co-Authored-By: Nicolas Camara <nick@sideguide.dev>
* Update Python SDK test to use TEST_API_KEY environment variable
Co-Authored-By: Nicolas Camara <nick@sideguide.dev>
* Update package.json
* Update __init__.py
---------
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: Nicolas Camara <nick@sideguide.dev>
Co-authored-by: Nicolas <nicolascamara29@gmail.com>
2025-04-12 16:47:24 -07:00
Nicolas
555dab50e7
Nick: bump
2025-03-24 20:17:22 +04:00
Nicolas
a50dc106ef
(feat/deep-research) Deep Research Alpha v1 - Structured Outputs + Customizability ( #1365 )
...
* Nick:
* Nick: structured output support
* Nick: support for zod and pydantic
2025-03-24 20:13:52 +04:00
Rafael Miller
e425667005
Merge branch 'main' into sdk-improv/async
2025-03-19 09:52:48 -03:00
rafaelmmiller
4f984d3fde
added origin to requests
2025-03-19 09:45:51 -03:00
Nicolas
723c16499d
Merge branch 'nsc/deep-research-prompts'
2025-03-18 15:53:02 -04:00
Nicolas
4fc5e6f6ca
Nick: added analysis prompt to the sdks
2025-03-18 15:52:55 -04:00
Rafael Miller
6d3c639f58
added 403s to sdk error handlers ( #1357 )
2025-03-17 18:06:29 +01:00
Nicolas
7e7b7e10fe
Nick: fixes py sdk
2025-03-16 23:02:16 -04:00
Nicolas
6d250360c2
Nick: bump
2025-03-16 22:45:16 -04:00
Nicolas
f1206e4870
Nick: urls optional on extract
2025-03-15 22:50:19 -04:00
rafaelmmiller
cc255d488e
fixed websocket params
2025-03-14 18:27:42 -03:00
Ademílson F. Tonato
97695dd55b
refator: dry request and error handling
2025-03-14 19:53:57 +00:00
rafaelmmiller
e7db5a2d5b
tomkosms review
2025-03-14 07:49:30 -03:00
rafaelmmiller
86f41460e0
removed v0 in example
2025-03-13 17:00:46 -03:00
rafaelmmiller
3641070ece
async
2025-03-13 16:27:59 -03:00
rafaelmmiller
6a5a4e5b6f
improv/types-and-comments-descs
2025-03-13 11:21:35 -03:00
Nicolas
60346ecfa3
Fix/p token ( #1305 )
...
* preview-token
* Nick:
---------
Co-authored-by: rafaelmmiller <150964962+rafaelsideguide@users.noreply.github.com>
2025-03-06 19:03:33 -03:00
Nicolas
4902d0ac64
Nick: fixes
2025-03-04 23:22:58 -03:00
Nicolas
8cfc946cae
Nick: fix system prompt missing from extract params
2025-03-04 23:04:20 -03:00
