Nicolas
6634d236bf
(feat/fire-1) FIRE-1 ( #1462 )
...
* wip
* integrating smart-scrape
* integrate smartscrape into llmExtract
* wip
* smart scrape multiple links
* fixes
* fix
* wip
* it worked!
* wip. there's a bug on the batchExtract TypeError: Converting circular structure to JSON
* wip
* retry model
* retry models
* feat/scrape+json+extract interfaces ready
* vertex -> googleapi
* fix/transformArrayToObject. required params on schema is still a bug
* change model
* o3-mini -> gemini
* Update extractSmartScrape.ts
* sessionId
* sessionId
* Nick: f-0 start
* Update extraction-service-f0.ts
* Update types.ts
* Nick:
* Update queue-worker.ts
* Nick: new interface
* rename analyzeSchemaAndPrompt -> F0
* refactor: rename agent ID to model in types and extract logic
* agent
* id->model
* id->model
* refactor: standardize agent model handling and validation across extraction logic
* livecast agent
* (feat/f1) sdks (#1459 )
* feat: add FIRE-1 agent support to Python and JavaScript SDKs
Co-Authored-By: hello@sideguide.dev <hello@sideguide.dev>
* feat: add FIRE-1 agent support to scrape methods in both SDKs
Co-Authored-By: hello@sideguide.dev <hello@sideguide.dev>
* feat: add prompt and sessionId to AgentOptions interface
Co-Authored-By: hello@sideguide.dev <hello@sideguide.dev>
* Update index.ts
---------
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: hello@sideguide.dev <hello@sideguide.dev>
Co-authored-by: Nicolas <nicolascamara29@gmail.com>
* feat(v1): rate limits
* Update types.ts
* Update llmExtract.ts
* add cost tracking
* remove
* Update requests.http
* fix smart scrape cost calc
* log sm cost
* fix counts
* fix
* expose cost tracking
* models fix
* temp: skipLibcheck
* get rid of it
* fix ts
* dont skip lib check
* Update extractSmartScrape.ts
* Update queue-worker.ts
* Update smartScrape.ts
* Update requests.http
* fix(rate-limiter):
* types: fire-1 refine
* bill 150
* fix credits used on crawl
* ban from crawl
* route cost limit warning
* Update generic-ai.ts
* genres
* Update llmExtract.ts
* test server diff
* cletu
---------
Co-authored-by: rafaelmmiller <150964962+rafaelsideguide@users.noreply.github.com>
Co-authored-by: Thomas Kosmas <thomas510111@gmail.com>
Co-authored-by: Ademílson F. Tonato <ademilsonft@outlook.com>
Co-authored-by: devin-ai-integration[bot] <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: hello@sideguide.dev <hello@sideguide.dev>
Co-authored-by: Gergő Móricz <mo.geryy@gmail.com>
2025-04-15 00:19:45 -07:00
devin-ai-integration[bot]
ef341399f0
Add change tracking support to Python and JS SDKs ( #1448 )
...
* Add change tracking support to Python and JS SDKs
Co-Authored-By: Nicolas Camara <nick@sideguide.dev>
* Replace test API keys with TEST_API_KEY placeholder
Co-Authored-By: Nicolas Camara <nick@sideguide.dev>
* Replace API keys with dummy values for testing
Co-Authored-By: Nicolas Camara <nick@sideguide.dev>
* Use environment variables for API keys in tests
Co-Authored-By: Nicolas Camara <nick@sideguide.dev>
* Move JS SDK test to correct location and add dependencies
Co-Authored-By: Nicolas Camara <nick@sideguide.dev>
* Remove old test file location
Co-Authored-By: Nicolas Camara <nick@sideguide.dev>
* Update test file to use TEST_API_KEY environment variable
Co-Authored-By: Nicolas Camara <nick@sideguide.dev>
* Update Python SDK test to use TEST_API_KEY environment variable
Co-Authored-By: Nicolas Camara <nick@sideguide.dev>
* Update package.json
* Update __init__.py
---------
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: Nicolas Camara <nick@sideguide.dev>
Co-authored-by: Nicolas <nicolascamara29@gmail.com>
2025-04-12 16:47:24 -07:00
Nicolas
555dab50e7
Nick: bump
2025-03-24 20:17:22 +04:00
Nicolas
a50dc106ef
(feat/deep-research) Deep Research Alpha v1 - Structured Outputs + Customizability ( #1365 )
...
* Nick:
* Nick: structured output support
* Nick: support for zod and pydantic
2025-03-24 20:13:52 +04:00
Nicolas
723c16499d
Merge branch 'nsc/deep-research-prompts'
2025-03-18 15:53:02 -04:00
Nicolas
4fc5e6f6ca
Nick: added analysis prompt to the sdks
2025-03-18 15:52:55 -04:00
Rafael Miller
6d3c639f58
added 403s to sdk error handlers ( #1357 )
2025-03-17 18:06:29 +01:00
Nicolas
7e7b7e10fe
Nick: fixes py sdk
2025-03-16 23:02:16 -04:00
Nicolas
6d250360c2
Nick: bump
2025-03-16 22:45:16 -04:00
Nicolas
f1206e4870
Nick: urls optional on extract
2025-03-15 22:50:19 -04:00
Nicolas
60346ecfa3
Fix/p token ( #1305 )
...
* preview-token
* Nick:
---------
Co-authored-by: rafaelmmiller <150964962+rafaelsideguide@users.noreply.github.com>
2025-03-06 19:03:33 -03:00
Nicolas
4902d0ac64
Nick: fixes
2025-03-04 23:22:58 -03:00
Nicolas
8cfc946cae
Nick: fix system prompt missing from extract params
2025-03-04 23:04:20 -03:00
Nicolas
aa54fd1658
Nick: only new activities/sources in the callback
2025-03-02 17:46:12 -03:00
Nicolas
33c59ee474
Nick: fixes
2025-03-02 17:41:19 -03:00
Nicolas
22d4f0de38
(feat/deep-research) Alpha prep + Improvements ( #1284 )
...
* Update index.ts
* Nick:
* Nick: topic -> query
* Update deep-research.ts
* Nick: bump
* Nick: add onSource callback
2025-03-02 17:33:21 -03:00
Gergő Móricz
c75522f535
feat(sdk): enforce timeout on client-side if set ( #1204 )
2025-02-20 13:35:31 +01:00
niazarak
e4504b3236
Use correct list typing for py 3.8 support ( #931 )
...
list[str] is not supported in Python 3.8
2025-02-20 07:39:46 +01:00
Eric Ciarla
d984b50400
Add llmstxt generator endpoint ( #1201 )
...
* Nick:
* Revert "fix(v1/types): fix extract -> json rename (FIR-1072) (#1195 )"
This reverts commit 586a10f40d354a038afc2b67809f20a7a829f8cb.
* Update deep-research-service.ts
* Nick:
* init
* part 2
* Update generate-llmstxt-service.ts
* Fix queue
* Update queue-worker.ts
* Almost there
* Final touches
* Update requests.http
* final touches
* Update requests.http
* Improve logging
* Change endpoint to /llmstxt
* Update queue-worker.ts
* Update generate-llmstxt-service.ts
* Nick: cache
* Update index.ts
* Update firecrawl.py
* Update package.json
---------
Co-authored-by: Nicolas <nicolascamara29@gmail.com>
Co-authored-by: Gergő Móricz <mo.geryy@gmail.com>
2025-02-19 14:42:33 -03:00
Nicolas
73ecaf74c2
feat(v1/extract) Show sources out of __experimental ( #1180 )
...
* Nick:
* Nick:
* Nick:
2025-02-13 12:41:45 -03:00
Nicolas
fe276060cf
Update pyproject.toml
2025-02-06 12:19:32 -03:00
Gergő Móricz
844ba39f74
fix(sdks): MIT license
2025-02-06 16:07:50 +01:00
Nicolas
492b81d7c3
Nick: origin api-sdk in python sdk
2025-01-31 12:20:41 -03:00
Nicolas
3604f2a3ae
Nick: misc improvements
2025-01-21 16:57:45 -03:00
Nicolas
16af54cf2b
Nick: bump sdks
2025-01-20 13:43:31 -03:00
Nicolas
ef69b1ac88
Nick: allowExternalLinks is now enableWebSearch
2025-01-20 13:41:30 -03:00
Nicolas
5d62e8264b
Nick:
2025-01-18 17:37:11 -03:00
Nicolas
b030a1c5da
Nick: extract to json in the sdks as well
2025-01-18 17:23:21 -03:00
Eric Ciarla
6383bf270a
Fix python sdk for extract
2025-01-18 17:12:06 -03:00
Eric Ciarla
3363b2d60e
Make prompt not required for extract on python sdk
2025-01-18 17:06:28 -03:00
Gergő Móricz
146dc47954
feat(sdk): check crawl/batch scrape errors
2025-01-17 18:06:04 +01:00
Gergő Móricz
805bfa457d
fix(python-sdk): add JSON parse error reporting clarity
2025-01-17 16:16:41 +01:00
Nicolas
7918d0e1c9
Nick: bump 1.12.0
2025-01-07 18:20:56 -03:00
Nicolas
b98e289f03
Nick:
2025-01-07 17:49:21 -03:00
Nicolas
a185c05a5c
Nick: sdk async and get status
2025-01-07 17:27:40 -03:00
Nicolas
9ec08d7020
Nick: fixed the sdks
2025-01-07 17:20:49 -03:00
Rafael Miller
a54a5dbb45
removed warnings
2025-01-03 17:13:34 -03:00
rafaelmmiller
55dad5ea13
fixed empty data with next causing infinite loop
2025-01-03 13:56:39 -03:00
rafaelmmiller
bafcc008bc
[SDK] fixed none and undefined on response
2025-01-03 13:27:00 -03:00
Nicolas
a4b6dfecd1
Nick: v1.8.0 - added /v1/search support
2025-01-02 20:02:07 -03:00
Nicolas
25da20efd2
Nick: e2e
2025-01-02 19:53:54 -03:00
Nicolas
eae393afb5
Nick: fixed js sdk
2025-01-02 19:52:50 -03:00
Nicolas
07a6ba5d91
Nick:
2025-01-02 19:34:37 -03:00
Nicolas
c822e34d37
Nick: fixed extract schema
2025-01-02 14:03:23 -03:00
Nicolas
6851281beb
Update __init__.py
2024-12-27 15:46:00 -03:00
Nicolas
cd08be7f37
Merge pull request #990 from RutamBhagat/python-sdk-conditionally-enforce-api-key
...
feat(python-sdk): Make API key optional for self-hosted instances
2024-12-27 15:43:37 -03:00
Nicolas
d1f3e26f9e
Nick: blocklist string
2024-12-20 18:09:49 -03:00
RutamBhagat
2b488cac3d
chore: remove pytest dependency from pyproject.toml
2024-12-20 01:54:29 -08:00
Nicolas
3e60f175bb
Nick: prompt should be optional on /extract sdks
2024-12-19 16:14:49 -03:00
Nicolas
8063474c85
Update __init__.py
2024-12-19 16:14:17 -03:00
