183 Commits

Author	SHA1	Message	Date
Nicolas	4fddc86e66	Update package.json	2024-12-19 16:09:08 -03:00
Nicolas	d67db99791	Merge pull request #994 from mendableai/feat/added-id-to-ws-sdks ... feat-SDK/added crawl id to ws	2024-12-19 16:08:08 -03:00
Nicolas	2d37dca9dc	Nick: introduced system prompt to /extract	2024-12-18 22:10:41 -03:00
rafaelmmiller	19246f6289	feat-SDK/added crawl id to ws	2024-12-18 18:36:04 -03:00
Nicolas	c325c3aa33	Nick: node sdk patch	2024-12-14 14:55:40 -03:00
Gergő Móricz	9cc6576571	feat(js-sdk/batch/scrape): add ignoreInvalidURLs option	2024-12-14 01:16:09 +01:00
Nicolas	6b17a53d4b	Update package.json	2024-12-12 21:53:15 -03:00
Nicolas	13afe4c733	Update index.ts	2024-12-12 21:52:20 -03:00
Nicolas	a47e278c97	Nick: bump node sdk	2024-12-09 19:25:48 -03:00
Gergő Móricz	fe6b003fcf	fix(js-sdk/batchScrapeUrls): zod support	2024-12-09 18:49:48 +01:00
Nicolas	dbda659e71	Nick: bump 1.9.1	2024-11-26 18:01:26 -03:00
Nicolas	bc0d66e96e	Nick: fixed extract types on node sdk	2024-11-26 18:00:49 -03:00
Nicolas	28696da6b2	Nick: gpt-4o	2024-11-20 12:25:50 -08:00
Nicolas	d02a8bcb82	Nick: extract urls to extract	2024-11-19 13:49:23 -08:00
rafaelmmiller	36cf49c959	Merge remote-tracking branch 'origin/main' into nsc/new-extract	2024-11-19 09:34:08 -03:00
Nicolas	f155449458	Nick: sitemap only	2024-11-14 17:29:53 -05:00
Nicolas	7bca4486b4	Update package.json	2024-11-14 16:37:53 -05:00
Móricz Gergő	df05124ef5	feat(v1/batch/scrape): webhooks	2024-11-14 22:36:28 +01:00
rafaelmmiller	41b45a844b	sdk allowexternallinks	2024-11-14 15:56:12 -03:00
rafaelmmiller	80d6cb16fb	sdks wip	2024-11-14 15:51:27 -03:00
Nicolas	0d1c4e4e09	Update package.json	2024-11-13 13:54:22 -05:00
Gergő Móricz	32be2cf786	feat(v1/webhook): complex webhook object w/ headers (#899) ... * feat(v1/webhook): complex webhook object w/ headers * feat(js-sdk/crawl): add complex webhook support	2024-11-13 19:36:44 +01:00
Nicolas	7d576d13bf	Update package.json	2024-11-11 15:42:10 -05:00
Gergő Móricz	a8dc75f762	feat(crawl): add parameter to treat differing query parameters as different URLs (#892) ... * add parameter to crawleroptions * add code to make it work	2024-11-11 21:36:22 +01:00
Nicolas	219f4732a0	Merge pull request #881 from mendableai/fix/scroll-action ... [BUG] fixes scroll action	2024-11-11 14:50:08 -05:00
Nicolas	ddbf3e45a3	Update package.json	2024-11-11 14:49:50 -05:00
Nicolas	56a1ac07a4	Merge pull request #878 from mendableai/mog/deduplicate-urls ... feat(crawl): Similar URL deduplication	2024-11-11 14:33:13 -05:00
rafaelmmiller	e241871b43	fixed scroll action on js sdk	2024-11-11 10:36:02 -03:00
Gergő Móricz	dc3a4e27fd	move param to the right place	2024-11-08 16:25:11 +01:00
Gergő Móricz	6ecf24b85e	feat(crawl): URL deduplication	2024-11-08 16:22:06 +01:00
Nicolas	7500ebe4c6	Nick: exec js actions	2024-11-06 11:56:23 -05:00
rafaelsideguide	61f659190d	bumped js-sdk version	2024-11-01 12:44:29 -03:00
Nicolas	80beedb46f	Update index.ts	2024-10-31 20:03:19 -03:00
Nicolas	6d38c65466	Update package.json	2024-10-28 20:25:28 -03:00
Nicolas	b6ce49e5bb	Update index.ts	2024-10-28 20:24:16 -03:00
Nicolas	9593ab80e1	Update README.md	2024-10-26 16:03:07 -03:00
Nicolas	19cac2220f	Nick:	2024-10-23 16:31:01 -03:00
Nicolas	b11035814a	Nick:	2024-10-23 16:10:21 -03:00
Nicolas	f0054da934	Nick: lgtm	2024-10-23 16:06:08 -03:00
Nicolas	60b6e6b1d4	Nick: fixes	2024-10-23 15:59:40 -03:00
Nicolas	d8abd15716	Nick: from bulk to batch	2024-10-23 15:37:24 -03:00
Gergő Móricz	3cd328cf93	feat(bulk/scrape): add node and python SDK integration + docs	2024-10-22 18:58:48 +02:00
Nicolas	bfed65d443	Update package.json	2024-10-10 17:46:49 -03:00
Nicolas	2cde877342	Nick: version bump	2024-10-10 17:44:27 -03:00
Nicolas	4960b2b0c2	Merge branch 'main' into feat-sdks/cancel-crawl	2024-10-10 17:43:20 -03:00
rafaelsideguide	2689ffa748	feat-sdk/cancel-crawl	2024-10-10 17:08:08 -03:00
rafaelsideguide	68a4c2e402	Fixed missing error handling in JS-SDK	2024-10-10 16:29:35 -03:00
Nicolas	4f7608821f	Update package.json	2024-10-03 17:36:20 -03:00
Nicolas	f743f2b922	Update index.ts	2024-10-03 17:34:29 -03:00
Nicolas	489a643391	Update index.ts	2024-10-02 20:25:52 -03:00