199 Commits

Author	SHA1	Message	Date
Nicolas	bcc18e1c07	Merge branch 'main' into fix-sdk/next-in-when-502	2024-12-26 12:53:10 -03:00
Nicolas	4f65d350a3	Update package.json	2024-12-26 12:52:52 -03:00
Nicolas	c911aad228	Update package.json	2024-12-23 18:48:03 -03:00
Nicolas	b1a5625b22	Revert "Merge pull request #997 from mendableai/feat/sdk-without-ws" ... This reverts commit 53cda5f81c53d3de35925c610ce083923ca09fbe, reversing changes made to 51f79b55efadc53243a8c22d86bb2d08d878d524.	2024-12-23 18:45:51 -03:00
Nicolas	0c1c4f2ede	Merge branch 'main' into feat/sdk-without-ws	2024-12-23 18:41:31 -03:00
Nicolas	67c643ad1c	Merge pull request #989 from RutamBhagat/js-sdk-conditionally-enforce-api-key ... feat(js-sdk): Make API key optional for self-hosted instances	2024-12-23 12:56:38 -03:00
Thomas Kosmas	199bd2d1f4	Merge branch 'main' into feat/sdk-without-ws	2024-12-21 02:32:09 +02:00
Thomas Kosmas	a9d31c8e42	Merge branch 'main' into feat/sdk-without-ws	2024-12-21 02:30:40 +02:00
Thomas Kosmas	f043f5fd61	Enhance error handling in E2E tests and introduce CrawlWatcher tests ... - Updated error messages in E2E tests to provide clearer feedback for blocked URLs and invalid API keys. - Added new test suite for CrawlWatcher to ensure proper instantiation and error handling when WebSocket is unavailable. - Improved test conditions for URL scraping and crawling to reflect updated error responses.	2024-12-21 02:27:22 +02:00
Nicolas	d1f3e26f9e	Nick: blocklist string	2024-12-20 18:09:49 -03:00
rafaelmmiller	63bbeadbfc	Added try catch to message handler	2024-12-20 08:05:13 -03:00
Nicolas	3e60f175bb	Nick: prompt should be optional on /extract sdks	2024-12-19 16:14:49 -03:00
Nicolas	4fddc86e66	Update package.json	2024-12-19 16:09:08 -03:00
Nicolas	d67db99791	Merge pull request #994 from mendableai/feat/added-id-to-ws-sdks ... feat-SDK/added crawl id to ws	2024-12-19 16:08:08 -03:00
Thomas Kosmas	c8cd0148dd	refactor: remove error logging for 'isows' module import in WebSocket initialization	2024-12-19 20:39:30 +02:00
Thomas Kosmas	6002bf3228	feat: dynamically import WebSocket module with error handling	2024-12-19 14:52:43 +02:00
Nicolas	2d37dca9dc	Nick: introduced system prompt to /extract	2024-12-18 22:10:41 -03:00
rafaelmmiller	19246f6289	feat-SDK/added crawl id to ws	2024-12-18 18:36:04 -03:00
RutamBhagat	e776847c71	feat(js-sdk): improve API key handling for cloud vs self-hosted services in FirecrawlApp	2024-12-17 13:40:14 -08:00
Nicolas	c325c3aa33	Nick: node sdk patch	2024-12-14 14:55:40 -03:00
Gergő Móricz	9cc6576571	feat(js-sdk/batch/scrape): add ignoreInvalidURLs option	2024-12-14 01:16:09 +01:00
rafaelmmiller	bdbc05a4c7	added check for object and trycatch as workaround for 502s	2024-12-13 18:33:39 -03:00
Nicolas	6b17a53d4b	Update package.json	2024-12-12 21:53:15 -03:00
Nicolas	13afe4c733	Update index.ts	2024-12-12 21:52:20 -03:00
Nicolas	a47e278c97	Nick: bump node sdk	2024-12-09 19:25:48 -03:00
Gergő Móricz	fe6b003fcf	fix(js-sdk/batchScrapeUrls): zod support	2024-12-09 18:49:48 +01:00
Nicolas	dbda659e71	Nick: bump 1.9.1	2024-11-26 18:01:26 -03:00
Nicolas	bc0d66e96e	Nick: fixed extract types on node sdk	2024-11-26 18:00:49 -03:00
Nicolas	28696da6b2	Nick: gpt-4o	2024-11-20 12:25:50 -08:00
Nicolas	d02a8bcb82	Nick: extract urls to extract	2024-11-19 13:49:23 -08:00
rafaelmmiller	36cf49c959	Merge remote-tracking branch 'origin/main' into nsc/new-extract	2024-11-19 09:34:08 -03:00
Nicolas	f155449458	Nick: sitemap only	2024-11-14 17:29:53 -05:00
Nicolas	7bca4486b4	Update package.json	2024-11-14 16:37:53 -05:00
Móricz Gergő	df05124ef5	feat(v1/batch/scrape): webhooks	2024-11-14 22:36:28 +01:00
rafaelmmiller	41b45a844b	sdk allowexternallinks	2024-11-14 15:56:12 -03:00
rafaelmmiller	80d6cb16fb	sdks wip	2024-11-14 15:51:27 -03:00
Nicolas	0d1c4e4e09	Update package.json	2024-11-13 13:54:22 -05:00
Gergő Móricz	32be2cf786	feat(v1/webhook): complex webhook object w/ headers (#899) ... * feat(v1/webhook): complex webhook object w/ headers * feat(js-sdk/crawl): add complex webhook support	2024-11-13 19:36:44 +01:00
Nicolas	7d576d13bf	Update package.json	2024-11-11 15:42:10 -05:00
Gergő Móricz	a8dc75f762	feat(crawl): add parameter to treat differing query parameters as different URLs (#892) ... * add parameter to crawleroptions * add code to make it work	2024-11-11 21:36:22 +01:00
Nicolas	219f4732a0	Merge pull request #881 from mendableai/fix/scroll-action ... [BUG] fixes scroll action	2024-11-11 14:50:08 -05:00
Nicolas	ddbf3e45a3	Update package.json	2024-11-11 14:49:50 -05:00
Nicolas	56a1ac07a4	Merge pull request #878 from mendableai/mog/deduplicate-urls ... feat(crawl): Similar URL deduplication	2024-11-11 14:33:13 -05:00
rafaelmmiller	e241871b43	fixed scroll action on js sdk	2024-11-11 10:36:02 -03:00
Gergő Móricz	dc3a4e27fd	move param to the right place	2024-11-08 16:25:11 +01:00
Gergő Móricz	6ecf24b85e	feat(crawl): URL deduplication	2024-11-08 16:22:06 +01:00
Nicolas	7500ebe4c6	Nick: exec js actions	2024-11-06 11:56:23 -05:00
rafaelsideguide	61f659190d	bumped js-sdk version	2024-11-01 12:44:29 -03:00
Nicolas	80beedb46f	Update index.ts	2024-10-31 20:03:19 -03:00
Nicolas	6d38c65466	Update package.json	2024-10-28 20:25:28 -03:00