130 Commits

Author	SHA1	Message	Date
Koushik Dutta	f103ddf660	openvino: fix npu/gpu crashes caused by dynamic input sizes	2025-02-16 15:32:02 -08:00
Koushik Dutta	47edffa56d	openvino: regenerate face embedding model	2025-02-16 11:50:05 -08:00
Koushik Dutta	86a5a73276	openvino: workaround for npu crash https://github.com/openvinotoolkit/openvino/issues/29003#issuecomment-2660865184	2025-02-15 08:17:02 -08:00
Koushik Dutta	1a47015558	openvino: more precise npu usage	2025-02-14 11:58:57 -08:00
Koushik Dutta	6fd35e54e6	openvino: rollback openvino	2025-02-12 15:36:57 -08:00
Koushik Dutta	a3f45e2c49	predict: favor ipv4 for file downloads	2025-02-10 09:14:34 -08:00
Koushik Dutta	b2cef35bc0	openvino: beta with latest	2025-02-09 09:02:02 -08:00
Koushik Dutta	98fe1d412a	openvino: do post processing inside callback rather than copy + thread post process	2024-12-31 15:03:16 -08:00
Koushik Dutta	c19ec63f98	openvino: fix ov.Tensor.data race condition	2024-12-31 12:44:38 -08:00
Koushik Dutta	a41e915f69	openvino: avoid ov.Tensor when using start_async due to thread safety?	2024-12-31 12:26:28 -08:00
Koushik Dutta	f0db59f6d2	openvino: fix thread affinity to possibly avoid async race conditions	2024-12-31 12:11:39 -08:00
Koushik Dutta	7ea849d357	openvino: massive perf improvements via async api usage	2024-12-29 23:20:17 -08:00
Koushik Dutta	919d2dee85	tensorflow-lite: missing files	2024-12-18 09:40:36 -08:00
Koushik Dutta	9c1be5865b	openvino: use relu face	2024-12-15 19:37:00 -08:00
Koushik Dutta	4585f43318	openvino: disable npu for recognition with user input	2024-12-11 15:54:16 -08:00
Koushik Dutta	30da19510a	openvino: disable npu for recognition	2024-12-11 15:53:40 -08:00
Koushik Dutta	539692867b	openvino: reenable npu	2024-12-10 12:22:13 -08:00
Koushik Dutta	6e60fe1c09	openvino: disable npu due to openvino bug	2024-12-06 10:07:43 -08:00
Koushik Dutta	70cf3488ef	openvino: add scrypted_yolov9t_relu_int8_320	2024-12-06 08:49:56 -08:00
Koushik Dutta	f2ece1270a	openvino: update to relu+int8 models	2024-12-02 22:49:58 -08:00
Koushik Dutta	a77f82462d	openvino: rollback openvino	2024-11-28 19:53:24 -08:00
Koushik Dutta	3a1401afbb	openvino: bump openvino	2024-11-28 19:44:47 -08:00
Koushik Dutta	f83cbfa5e7	predict: use new cluster worker labels	2024-11-23 18:39:29 -08:00
Koushik Dutta	38c00f5b9b	openvino: fix cluster label to require x64	2024-11-22 19:01:20 -08:00
Koushik Dutta	ab4738973d	predict: cluster for should enforce compute/darwin label	2024-11-22 17:08:43 -08:00
Koushik Dutta	ea065f506c	predict: fix load balancer	2024-11-21 21:53:09 -08:00
Koushik Dutta	6618129e1d	server: cluster load balancing	2024-11-21 20:54:20 -08:00
Koushik Dutta	1a72eddcc8	predict: formatting	2024-11-21 15:22:35 -08:00
Koushik Dutta	1c9037dc35	predict: fix worker startup on primary server	2024-11-21 15:22:16 -08:00
Koushik Dutta	cd0ab104ea	predict: formatting	2024-11-21 14:52:01 -08:00
Koushik Dutta	c6f4c1a669	onnx: implement clustering. and cleanup coreml/openvino.	2024-11-21 14:51:31 -08:00
Koushik Dutta	9f28e38716	openvino: cluster support	2024-11-21 14:37:49 -08:00
Koushik Dutta	da1f6118c8	predict: wip coreml clustering across multiple macs	2024-11-20 22:27:20 -08:00
Koushik Dutta	75b2ff22ce	openvino: regenerate models	2024-11-18 13:46:19 -08:00
Koushik Dutta	ef04398a79	openvino: 9c relu int8	2024-11-17 19:15:43 -08:00
Koushik Dutta	cbfad097db	predict: sanitzation	2024-11-10 10:15:12 -08:00
Koushik Dutta	c9e83c496c	openvino: rollback openvino off nightly	2024-11-10 08:51:07 -08:00
Koushik Dutta	442e1883c5	openvino: quantize test	2024-11-10 08:47:51 -08:00
Koushik Dutta	a616e95c0e	detect: use opencv-headless	2024-11-08 09:14:11 -08:00
Koushik Dutta	5899ad866a	openvino: invalid device recovery	2024-11-05 08:38:52 -08:00
Koushik Dutta	5848cf1e5e	predict: Fix nans in payloads causing plugin crash, add support for yuv models	2024-11-01 10:34:29 -07:00
Koushik Dutta	0ecacfd974	openvino: update openvino to 2014.4.0	2024-09-25 08:56:14 -07:00
Koushik Dutta	c42b8ecda2	openvino/lxc: fix crashing	2024-09-12 10:49:18 -07:00
Koushik Dutta	521bb62f10	openvino: better gpu failure fallback	2024-09-11 16:55:20 -07:00
Koushik Dutta	96335544ad	openvino: openvino 2024.2.0 is crashy	2024-09-11 12:52:38 -07:00
Koushik Dutta	674034fb7e	openvino: GPU to AUTO fallback on error	2024-09-11 10:13:45 -07:00
Koushik Dutta	44dcfe5e12	openvino: rollback	2024-09-11 10:08:30 -07:00
Koushik Dutta	67acb7725f	openvino: fix model execution	2024-09-10 19:56:42 -07:00
Koushik Dutta	40b7b621a0	openvino: update	2024-09-01 08:17:54 -07:00
Koushik Dutta	7104ad6378	openvino: improve device selection	2024-08-29 21:15:19 -07:00