147 Commits

Author	SHA1	Message	Date
Koushik Dutta	98fe1d412a	openvino: do post processing inside callback rather than copy + thread post process	2024-12-31 15:03:16 -08:00
Koushik Dutta	c19ec63f98	openvino: fix ov.Tensor.data race condition	2024-12-31 12:44:38 -08:00
Koushik Dutta	a41e915f69	openvino: avoid ov.Tensor when using start_async due to thread safety?	2024-12-31 12:26:28 -08:00
Koushik Dutta	f0db59f6d2	openvino: fix thread affinity to possibly avoid async race conditions	2024-12-31 12:11:39 -08:00
Koushik Dutta	7ea849d357	openvino: massive perf improvements via async api usage	2024-12-29 23:20:17 -08:00
Koushik Dutta	919d2dee85	tensorflow-lite: missing files	2024-12-18 09:40:36 -08:00
Koushik Dutta	9c1be5865b	openvino: use relu face	2024-12-15 19:37:00 -08:00
Koushik Dutta	4585f43318	openvino: disable npu for recognition with user input	2024-12-11 15:54:16 -08:00
Koushik Dutta	30da19510a	openvino: disable npu for recognition	2024-12-11 15:53:40 -08:00
Koushik Dutta	539692867b	openvino: reenable npu	2024-12-10 12:22:13 -08:00
Koushik Dutta	6e60fe1c09	openvino: disable npu due to openvino bug	2024-12-06 10:07:43 -08:00
Koushik Dutta	70cf3488ef	openvino: add scrypted_yolov9t_relu_int8_320	2024-12-06 08:49:56 -08:00
Koushik Dutta	e2eba2a227	openvino: beta	2024-12-05 08:46:36 -08:00
Koushik Dutta	f2ece1270a	openvino: update to relu+int8 models	2024-12-02 22:49:58 -08:00
Koushik Dutta	a77f82462d	openvino: rollback openvino	2024-11-28 19:53:24 -08:00
Koushik Dutta	3a1401afbb	openvino: bump openvino	2024-11-28 19:44:47 -08:00
Koushik Dutta	7bd4f4053d	predict: publish	2024-11-23 21:50:38 -08:00
Koushik Dutta	f83cbfa5e7	predict: use new cluster worker labels	2024-11-23 18:39:29 -08:00
Koushik Dutta	101d362260	openvino: beta	2024-11-22 21:20:09 -08:00
Koushik Dutta	38c00f5b9b	openvino: fix cluster label to require x64	2024-11-22 19:01:20 -08:00
Koushik Dutta	ab4738973d	predict: cluster for should enforce compute/darwin label	2024-11-22 17:08:43 -08:00
Koushik Dutta	ea065f506c	predict: fix load balancer	2024-11-21 21:53:09 -08:00
Koushik Dutta	6618129e1d	server: cluster load balancing	2024-11-21 20:54:20 -08:00
Koushik Dutta	1a72eddcc8	predict: formatting	2024-11-21 15:22:35 -08:00
Koushik Dutta	1c9037dc35	predict: fix worker startup on primary server	2024-11-21 15:22:16 -08:00
Koushik Dutta	cd0ab104ea	predict: formatting	2024-11-21 14:52:01 -08:00
Koushik Dutta	c6f4c1a669	onnx: implement clustering. and cleanup coreml/openvino.	2024-11-21 14:51:31 -08:00
Koushik Dutta	9f28e38716	openvino: cluster support	2024-11-21 14:37:49 -08:00
Koushik Dutta	da1f6118c8	predict: wip coreml clustering across multiple macs	2024-11-20 22:27:20 -08:00
Koushik Dutta	7a22e17d84	Merge branch 'main' into cluster	2024-11-18 13:46:27 -08:00
Koushik Dutta	75b2ff22ce	openvino: regenerate models	2024-11-18 13:46:19 -08:00
Koushik Dutta	edde093140	Merge branch 'main' into cluster	2024-11-18 13:03:14 -08:00
Koushik Dutta	4ec001c2a2	server: assign workers ids	2024-11-18 10:11:33 -08:00
Koushik Dutta	ef04398a79	openvino: 9c relu int8	2024-11-17 19:15:43 -08:00
Koushik Dutta	8f1a673db5	server: refactor cluster	2024-11-15 10:02:13 -08:00
Koushik Dutta	49e3fc1438	predict: fix cluster labels	2024-11-15 10:02:13 -08:00
Koushik Dutta	5ff8a65c4a	predict: add cluster label settings to package.json	2024-11-15 10:02:13 -08:00
Koushik Dutta	8954de3c93	predict: beta	2024-11-10 10:16:03 -08:00
Koushik Dutta	cbfad097db	predict: sanitzation	2024-11-10 10:15:12 -08:00
Koushik Dutta	c9e83c496c	openvino: rollback openvino off nightly	2024-11-10 08:51:07 -08:00
Koushik Dutta	442e1883c5	openvino: quantize test	2024-11-10 08:47:51 -08:00
Koushik Dutta	a616e95c0e	detect: use opencv-headless	2024-11-08 09:14:11 -08:00
Koushik Dutta	5899ad866a	openvino: invalid device recovery	2024-11-05 08:38:52 -08:00
Koushik Dutta	17ecb56259	openvino: initial yuv support	2024-11-04 12:04:18 -08:00
Koushik Dutta	6ddef853ad	predict: publish	2024-11-01 10:52:30 -07:00
Koushik Dutta	5848cf1e5e	predict: Fix nans in payloads causing plugin crash, add support for yuv models	2024-11-01 10:34:29 -07:00
Koushik Dutta	0ecacfd974	openvino: update openvino to 2014.4.0	2024-09-25 08:56:14 -07:00
Koushik Dutta	c42b8ecda2	openvino/lxc: fix crashing	2024-09-12 10:49:18 -07:00
Koushik Dutta	521bb62f10	openvino: better gpu failure fallback	2024-09-11 16:55:20 -07:00
Koushik Dutta	96335544ad	openvino: openvino 2024.2.0 is crashy	2024-09-11 12:52:38 -07:00