3127 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Nicolas	c3eecf7b9f	Update index.ts	2024-07-12 10:22:06 -04:00
sanix-darker	3a744eb963	feat: update the doc and version	2024-07-12 15:33:31 +02:00
sanix-darker	2ae2ccad1c	chore: update license on Cargo.toml	2024-07-12 15:32:57 +02:00
sanix-darker	80af390557	chore: update doc and libs	2024-07-12 15:22:55 +02:00
sanix-darker	6ea36d38f3	chore: no need for Makefile	2024-07-12 15:10:12 +02:00
sanix-darker	d7bbb22ae4	feat: update fly github action	2024-07-12 15:06:54 +02:00
sanix-darker	9deaa8b0e9	feat: add rust sdk ci github action	2024-07-12 14:58:41 +02:00
sanix-darker	0b19c940f1	fix: format the rust code	2024-07-12 14:58:11 +02:00
sanix-darker	aa9d49cfda	fix(test): updates and keep relevant tests	2024-07-12 14:41:53 +02:00
sanix-darker	21983011b9	feat: update tests	2024-07-12 14:07:58 +02:00
sanix-darker	d86de4f5a6	feat: add Debug to FireCrawl	2024-07-12 14:07:23 +02:00
sanix-darker	d8f67d5045	chore(doc): adding sdk rust lib	2024-07-12 13:59:41 +02:00
sanix-darker	20932f7b31	feat(test): start implementing tests for the lib	2024-07-12 13:59:04 +02:00
sanix-darker	2f6215c492	feat: add dotenv and assert-match as dev dependencies	2024-07-12 13:58:38 +02:00
Gergo Moricz	10957b748b	fix(bull): requeue jobs after restart	2024-07-12 13:55:53 +02:00
sanix-darker	bcf596c310	fix: license	2024-07-12 13:20:39 +02:00
sanix-darker	04e94cdb20	chore: update cargo.toml file by adding more elements	2024-07-12 13:15:24 +02:00
Nicolas	961b27811d	Merge pull request #386 from mendableai/feat/fire-engine-fallback-for-sitemap ... [Feat] Added fire-engine fallback for getting sitemaps	2024-07-11 20:38:01 -04:00
Nicolas	84de63dbeb	Merge pull request #375 from StefanTerdell/self-host-qol ... Self-hosting quality of life fixes	2024-07-11 20:37:39 -04:00
Nicolas	30c1118713	Merge pull request #326 from mendableai/feat/save-docs-on-supabase ... [Feat] Added implementation for saving docs on supabase	2024-07-11 20:27:41 -04:00
jhoseph88	68828a5b5c	Pass along current, total, current_step, and current_url in js sdk	2024-07-11 19:37:09 -04:00
Gergo Moricz	7e3a368684	fix: unpause globally	2024-07-12 00:05:35 +02:00
Gergo Moricz	ee1d41406e	feat: unpause by http request	2024-07-11 23:56:36 +02:00
Gergo Moricz	f64a2d8668	fix: rename fly tomls to original	2024-07-11 23:21:02 +02:00
Gergo Moricz	bd84290b9e	fix: reenable hyperdx	2024-07-11 23:20:51 +02:00
Gergo Moricz	09bca05b20	feat: fix iteration 3 (actually works)	2024-07-11 23:14:15 +02:00
Gergo Moricz	9cd7d79b64	feat: avoid double SIGINT crashing	2024-07-11 20:35:15 +02:00
Gergo Moricz	eaa8db4b19	fix(fly): raise kill timeout for graceful shutdown	2024-07-11 20:09:06 +02:00
Gergo Moricz	bffb9f8fd0	feat: stuck job restoration iteration 2	2024-07-11 20:08:21 +02:00
sanix-darker	404aeb3daa	feat: add an example rust code to tests it	2024-07-11 16:48:04 +02:00
sanix-darker	3c49f0e055	chore: update deps by allowing bumps + add uuid	2024-07-11 16:47:44 +02:00
rafaelsideguide	86d0e88a91	removed hyperdx (they also have graceful shutdown) and tried to change the process for running on server. It didn't work.	2024-07-10 18:29:55 -03:00
rafaelsideguide	7c3cc89a80	Merge branch 'feat/save-docs-on-supabase' of https://github.com/mendableai/firecrawl into feat/save-docs-on-supabase	2024-07-09 18:48:29 -03:00
rafaelsideguide	9ad06fdf56	added fire-engine fallback for getting sitemaps	2024-07-09 16:07:53 -03:00
Gergo Moricz	1a07e9d23b	feat: pick up and commit interrupted jobs from/to DB	2024-07-09 15:57:38 +02:00
Gergo Moricz	6a524e1bae	feat: pick up and commit interrupted jobs from/to DB	2024-07-09 14:56:47 +02:00
Gergo Moricz	77aa46588f	feat: graceful exit handler	2024-07-09 14:29:32 +02:00
Nicolas	fcc67a3c9e	Merge pull request #370 from mendableai/bug/fixing-cicd ... dependabot for security checks, fixed crawl test	2024-07-08 19:26:18 -03:00
Eric Ciarla	51e6579d70	Update README.md	2024-07-08 17:09:17 -04:00
Eric Ciarla	f8e79dd729	Update integrations	2024-07-08 17:02:20 -04:00
Eric Ciarla	afb49e21e7	Update SDKs to MIT license	2024-07-08 13:37:53 -04:00
Nicolas	002bfdf639	Merge pull request #374 from StefanTerdell/fix-372 ... Only check Supabase if configured to when cancelling job	2024-07-07 22:53:15 -03:00
Stefan Terdell	188fe56203	Optional jobId webhook URL templating	2024-07-07 15:11:45 +02:00
Stefan Terdell	fcedcccf2d	Include self hosted webhook env and allow connections to localhost	2024-07-07 15:10:35 +02:00
Stefan Terdell	a2ae5f81d9	Only check Supabase if configured to	2024-07-07 15:06:31 +02:00
sanix-darker	e24bbcc6eb	feat: rust sdk initial commit	2024-07-07 14:42:20 +02:00
Nicolas	e779dbbe26	Merge pull request #371 from mendableai/feat/issue-342 ... [Feat] Added veeva to special case params	2024-07-06 12:25:22 -03:00
rafaelsideguide	c2bba54b4f	Added veeva to special case params	2024-07-05 16:58:07 -03:00
rafaelsideguide	a2cdc520e6	dependabot for security checks, fixed crawl test	2024-07-05 14:49:03 -03:00
Rafael Miller	2b36de605a	Merge pull request #349 from mendableai/dependabot/npm_and_yarn/apps/api/prod-deps-5b38a50718 ... apps/api(deps): bump the prod-deps group in /apps/api with 28 updates	2024-07-05 14:05:50 -03:00