7477 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Koushik Dutta	2fbfe2cb65	server: more logging	2024-11-20 18:28:12 -08:00
Koushik Dutta	32ede1f7fe	postbeta	2024-11-20 18:16:09 -08:00
Koushik Dutta	1a2ec8ab4e	server: log startup	2024-11-20 18:16:01 -08:00
Koushik Dutta	53cab91b02	server: refactor runtime worker creation	2024-11-20 14:53:58 -08:00
Koushik Dutta	02a46a9202	postbeta	2024-11-20 12:38:06 -08:00
Koushik Dutta	69f4de66e9	server: exit hooks for python fork	2024-11-20 12:18:25 -08:00
Koushik Dutta	aed6e0c446	server: wip cluster mode load balancing	2024-11-20 11:39:21 -08:00
Koushik Dutta	432c178f29	sdk: more cluster fixes for python	2024-11-20 10:58:10 -08:00
Koushik Dutta	bcf698daa3	sdk: expose ClusterManager to python	2024-11-20 10:13:54 -08:00
Koushik Dutta	347a957cd3	sdk: add cluster manager	2024-11-20 10:10:47 -08:00
Koushik Dutta	459b95a0e2	server: python cluster worker routing	2024-11-18 21:33:49 -08:00
Koushik Dutta	1c18129449	postbeta	2024-11-18 21:05:37 -08:00
Koushik Dutta	21274df881	server: fix cluster check nre	2024-11-18 21:05:28 -08:00
Koushik Dutta	ca243e79bb	server: apply default runtime for cluster fork	2024-11-18 21:03:00 -08:00
Koushik Dutta	924394d365	postbeta	2024-11-18 19:50:15 -08:00
Koushik Dutta	23167da88b	server: fork by clusterWorkerId	2024-11-18 19:29:07 -08:00
Koushik Dutta	c1d48e1c6b	sdk: add cluster worker request to fork	2024-11-18 15:47:31 -08:00
Koushik Dutta	7a22e17d84	Merge branch 'main' into cluster	2024-11-18 13:46:27 -08:00
Koushik Dutta	75b2ff22ce	openvino: regenerate models	2024-11-18 13:46:19 -08:00
Koushik Dutta	edde093140	Merge branch 'main' into cluster	2024-11-18 13:03:14 -08:00
Koushik Dutta	8622934c8b	coreml: cluster support	2024-11-18 13:00:24 -08:00
Koushik Dutta	153cc3ed94	server: python cleanup	2024-11-18 12:26:46 -08:00
Koushik Dutta	2ae6113750	server: wip python cluster fork	2024-11-18 11:31:52 -08:00
Koushik Dutta	4ec001c2a2	server: assign workers ids	2024-11-18 10:11:33 -08:00
Koushik Dutta	794ac6c8d2	postbeta	2024-11-18 09:38:13 -08:00
Koushik Dutta	8422ffe55a	postbeta	2024-11-17 22:20:51 -08:00
Koushik Dutta	285c07e33e	postbeta	2024-11-17 20:43:46 -08:00
Koushik Dutta	ef04398a79	openvino: 9c relu int8	2024-11-17 19:15:43 -08:00
Koushik Dutta	6429ea718a	postbeta	2024-11-17 15:38:52 -08:00
Koushik Dutta	5f9147e720	server: fix node cluster ping	2024-11-17 15:38:42 -08:00
Koushik Dutta	ea4922d8e5	onnx: fix provider detection	2024-11-17 10:24:09 -08:00
Koushik Dutta	70293ca827	server: cluster affinity	2024-11-16 19:35:40 -08:00
Koushik Dutta	878487180e	postbeta	2024-11-16 19:07:05 -08:00
Koushik Dutta	f094903ed9	server: fix cluster fork liveness leak	2024-11-16 19:06:53 -08:00
Koushik Dutta	5117e217cf	core: publish	2024-11-16 11:48:13 -08:00
Koushik Dutta	07c3f2832a	postbeta	2024-11-16 11:35:50 -08:00
Koushik Dutta	977666bc3c	server: add worker ids	2024-11-16 11:35:39 -08:00
Koushik Dutta	2ec6760308	nvidia: notes	2024-11-16 11:07:51 -08:00
Koushik Dutta	0dbe556835	diagnostics: use a better defaults for detection plugin verification	2024-11-16 09:40:34 -08:00
Koushik Dutta	c4f76df255	onnx: fix execution provider reporting	2024-11-16 09:32:55 -08:00
Koushik Dutta	0bf0ec08ab	server: plugin init cleanups	2024-11-15 23:40:38 -08:00
Koushik Dutta	1a2216a7de	postbeta	2024-11-15 22:43:29 -08:00
Koushik Dutta	d868c3b3bb	server: remove stats checker	2024-11-15 22:43:19 -08:00
Koushik Dutta	882709ea51	server: cluster fork tracking	2024-11-15 22:00:51 -08:00
Koushik Dutta	df249c554c	common: persistent fork service	2024-11-15 21:41:07 -08:00
Koushik Dutta	fcbaeb1d1d	postbeta	2024-11-15 19:54:12 -08:00
Koushik Dutta	c6dda05fa4	server: force ipv4 on cluster connect	2024-11-15 19:54:01 -08:00
Koushik Dutta	953b7812c5	server: shuffle python cluster code	2024-11-15 19:53:16 -08:00
Koushik Dutta	7434a5c4ba	postbeta	2024-11-15 15:06:09 -08:00
Koushik Dutta	b240a17bb0	server: support hostnames in clustering, and auto detection of client cluster addresses for easy image cloning.	2024-11-15 15:03:32 -08:00