216 Commits

Author SHA1 Message Date
devin-ai-integration[bot]
f0b1507290
Fix: Handle both dict and model instances in actions parameter (#1508)
* Fix: Handle both dict and model instances in actions parameter

Co-Authored-By: Nicolas Camara <nicolascamara29@gmail.com>

* Update __init__.py

---------

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: Nicolas Camara <nicolascamara29@gmail.com>
2025-04-29 13:06:12 -03:00
Nicolas
6dbfd54e2c Update __init__.py 2025-04-29 12:22:30 -03:00
Rafael Miller
317fa43f9e
Fix sdk/schemas (#1507)
* sdk-fix/schema-check

* version bump

* schema validation for extract and jsonOptions parameters

* Update firecrawl.py

---------

Co-authored-by: Nicolas <nicolascamara29@gmail.com>
2025-04-29 12:19:08 -03:00
Nicolas
a0a1675829
Nick: (#1506) 2025-04-29 11:06:35 -03:00
Nicolas
8053a7cedd Nick: updates on pypi 2025-04-28 15:01:12 -03:00
Arvid Andersson
c164370298
Webhook param for batch scrape (#1505)
The API endpoint supports the webhook param, align the client to support this.
2025-04-28 13:27:10 -03:00
Rafael Miller
e3e730f2c1
Update version to 2.4.0 and enhance ExtractResponse model with additional fields for id, status, and expiresAt. (#1501) 2025-04-25 23:19:08 -04:00
Nicolas
5c3951b42e Update __init__.py 2025-04-24 12:31:02 -04:00
John Bledsoe
ca82015bca
Use async job status monitor for AsyncFirecrawlApp (#1498) 2025-04-24 12:28:29 -04:00
Rafael Miller
e10d4c7b0c
[fix/sdk] kwargs params (#1490)
* fix sdk kwargs params

* version

* Update __init__.py

---------

Co-authored-by: Nicolas <nicolascamara29@gmail.com>
2025-04-22 15:15:32 -04:00
rafaelmmiller
a4323d8f23 fix:python-sdk 2025-04-19 12:53:37 -07:00
Nicolas
2c72097c3f Nick: 2025-04-18 13:44:16 -07:00
Nicolas
c7df80e2a8 Update __init__.py 2025-04-18 13:42:21 -07:00
rafaelmmiller
91ebd140e5 version bump 2025-04-18 13:37:34 -07:00
rafaelmmiller
0aedef7210 fix 2025-04-18 13:37:09 -07:00
rafaelmmiller
79bc54c11e scrape options fixing types 2025-04-18 13:00:05 -07:00
Nicolas
16439b1c7e Nick: examples 2025-04-18 02:00:00 -07:00
Nicolas
a74b2dc59f Nick: json config instead of extract config 2025-04-18 01:54:15 -07:00
Nicolas
06c54bc41c Update __init__.py 2025-04-18 01:43:18 -07:00
Nicolas
9e67d7ba22 Nick: 2025-04-18 01:30:40 -07:00
Nicolas
37e076e151 Merge branch 'sdk-improv/async' of https://github.com/mendableai/firecrawl into sdk-improv/async 2025-04-18 01:28:39 -07:00
Nicolas
9ba1ae9ae1 Nick: 2025-04-18 01:28:31 -07:00
rafaelmmiller
55c04d615e Merge branch 'sdk-improv/async' of https://github.com/mendableai/firecrawl into sdk-improv/async 2025-04-18 01:21:29 -07:00
rafaelmmiller
0915db515c async functions 2025-04-18 01:20:16 -07:00
Nicolas
a3f3168212 Nick: python sdk 2.0 2025-04-18 01:15:14 -07:00
Nicolas
f3522666db Nick: new examples 2025-04-18 01:13:53 -07:00
Nicolas
0001d6ea25 Merge branch 'sdk-improv/async' of https://github.com/mendableai/firecrawl into sdk-improv/async 2025-04-18 01:12:31 -07:00
Nicolas
0b62be5874 Update firecrawl.py 2025-04-18 01:12:24 -07:00
rafaelmmiller
5db76992de Merge branch 'sdk-improv/async' of https://github.com/mendableai/firecrawl into sdk-improv/async 2025-04-18 01:07:30 -07:00
rafaelmmiller
8cd82b5600 async scrape 2025-04-18 01:06:58 -07:00
Nicolas
1aa0c092e0 Update firecrawl.py 2025-04-18 01:01:01 -07:00
Nicolas
390f3d44a3 Update firecrawl.py 2025-04-18 00:51:06 -07:00
Nicolas
d8792d2301 Update firecrawl.py 2025-04-18 00:48:07 -07:00
Nicolas
5e6e41ab17 Update firecrawl.py 2025-04-18 00:37:34 -07:00
rafaelmmiller
a655d24e7c scrape params commentary 2025-04-18 00:29:20 -07:00
Nicolas
8c5509cbb4 Update firecrawl.py 2025-04-18 00:26:00 -07:00
rafaelmmiller
b67bc707d5 Merge branch 'sdk-improv/async' of https://github.com/mendableai/firecrawl into sdk-improv/async 2025-04-18 00:00:21 -07:00
rafaelmmiller
85247991bc generic 2025-04-18 00:00:18 -07:00
Nicolas
287032017b Merge branch 'sdk-improv/async' of https://github.com/mendableai/firecrawl into sdk-improv/async 2025-04-17 23:50:57 -07:00
Nicolas
8eb4e1a96a Update firecrawl.py 2025-04-17 23:50:56 -07:00
rafaelmmiller
23ef26655c params 2025-04-17 23:37:45 -07:00
rafaelmmiller
22cfdd6ae3 added agent options types 2025-04-17 23:31:28 -07:00
Nicolas
f48937a55d Update firecrawl.py 2025-04-17 23:17:00 -07:00
Nicolas
d9780412f5 Update firecrawl.py 2025-04-17 23:08:33 -07:00
Nicolas
c67425ad8b Merge branch 'main' into sdk-improv/async 2025-04-17 22:59:07 -07:00
Nicolas
5aa9469081 Update __init__.py 2025-04-17 11:14:09 -07:00
Nicolas
6634d236bf
(feat/fire-1) FIRE-1 (#1462)
* wip

* integrating smart-scrape

* integrate smartscrape into llmExtract

* wip

* smart scrape multiple links

* fixes

* fix

* wip

* it worked!

* wip. there's a bug on the batchExtract TypeError: Converting circular structure to JSON

* wip

* retry model

* retry models

* feat/scrape+json+extract interfaces ready

* vertex -> googleapi

* fix/transformArrayToObject. required params on schema is still a bug

* change model

* o3-mini -> gemini

* Update extractSmartScrape.ts

* sessionId

* sessionId

* Nick: f-0 start

* Update extraction-service-f0.ts

* Update types.ts

* Nick:

* Update queue-worker.ts

* Nick: new interface

* rename analyzeSchemaAndPrompt -> F0

* refactor: rename agent ID to model in types and extract logic

* agent

* id->model

* id->model

* refactor: standardize agent model handling and validation across extraction logic

* livecast agent

* (feat/f1) sdks (#1459)

* feat: add FIRE-1 agent support to Python and JavaScript SDKs

Co-Authored-By: hello@sideguide.dev <hello@sideguide.dev>

* feat: add FIRE-1 agent support to scrape methods in both SDKs

Co-Authored-By: hello@sideguide.dev <hello@sideguide.dev>

* feat: add prompt and sessionId to AgentOptions interface

Co-Authored-By: hello@sideguide.dev <hello@sideguide.dev>

* Update index.ts

---------

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: hello@sideguide.dev <hello@sideguide.dev>
Co-authored-by: Nicolas <nicolascamara29@gmail.com>

* feat(v1): rate limits

* Update types.ts

* Update llmExtract.ts

* add cost tracking

* remove

* Update requests.http

* fix smart scrape cost calc

* log sm cost

* fix counts

* fix

* expose cost tracking

* models fix

* temp: skipLibcheck

* get rid of it

* fix ts

* dont skip lib check

* Update extractSmartScrape.ts

* Update queue-worker.ts

* Update smartScrape.ts

* Update requests.http

* fix(rate-limiter):

* types: fire-1 refine

* bill 150

* fix credits used on crawl

* ban from crawl

* route cost limit warning

* Update generic-ai.ts

* genres

* Update llmExtract.ts

* test server diff

* cletu

---------

Co-authored-by: rafaelmmiller <150964962+rafaelsideguide@users.noreply.github.com>
Co-authored-by: Thomas Kosmas <thomas510111@gmail.com>
Co-authored-by: Ademílson F. Tonato <ademilsonft@outlook.com>
Co-authored-by: devin-ai-integration[bot] <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: hello@sideguide.dev <hello@sideguide.dev>
Co-authored-by: Gergő Móricz <mo.geryy@gmail.com>
2025-04-15 00:19:45 -07:00
devin-ai-integration[bot]
ef341399f0
Add change tracking support to Python and JS SDKs (#1448)
* Add change tracking support to Python and JS SDKs

Co-Authored-By: Nicolas Camara <nick@sideguide.dev>

* Replace test API keys with TEST_API_KEY placeholder

Co-Authored-By: Nicolas Camara <nick@sideguide.dev>

* Replace API keys with dummy values for testing

Co-Authored-By: Nicolas Camara <nick@sideguide.dev>

* Use environment variables for API keys in tests

Co-Authored-By: Nicolas Camara <nick@sideguide.dev>

* Move JS SDK test to correct location and add dependencies

Co-Authored-By: Nicolas Camara <nick@sideguide.dev>

* Remove old test file location

Co-Authored-By: Nicolas Camara <nick@sideguide.dev>

* Update test file to use TEST_API_KEY environment variable

Co-Authored-By: Nicolas Camara <nick@sideguide.dev>

* Update Python SDK test to use TEST_API_KEY environment variable

Co-Authored-By: Nicolas Camara <nick@sideguide.dev>

* Update package.json

* Update __init__.py

---------

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: Nicolas Camara <nick@sideguide.dev>
Co-authored-by: Nicolas <nicolascamara29@gmail.com>
2025-04-12 16:47:24 -07:00
Nicolas
555dab50e7 Nick: bump 2025-03-24 20:17:22 +04:00
Nicolas
a50dc106ef
(feat/deep-research) Deep Research Alpha v1 - Structured Outputs + Customizability (#1365)
* Nick:

* Nick: structured output support

* Nick: support for zod and pydantic
2025-03-24 20:13:52 +04:00