541bd4d4d9 
								
									
								
							
								 
							
						 
						
							
							
								
								ui: switch spinner and text window back to standalone process ( #35470 )  
							
							... 
							
							
 
							
							switch spinner and text window back to standalone process 
							
						 
						
							5 months ago  
				
					
						
							
							
								 
						
							
							
								f1ba6c389b 
								
									
								
							
								 
							
						 
						
							
							
								
								quick repo garbage collection ( #35274 )  
							
							... 
							
							
 
							
							* start gc
* lil more
* debug
* no sound
* add back 
							
						 
						
							6 months ago  
				
					
						
							
							
								 
						
							
							
								47ed90c6cf 
								
									
								
							
								 
							
						 
						
							
							
								
								Reapply "Mypy: Got passing on macos ( #34591 )" ( #35126 ) ( #35153 )  
							
							... 
							
							
 
							
							* Mypy: Got passing on macos (#34591 )
* Mypy: Got mypy passing on macos
* common/realtime.py refactor
* Mypy: mypy passing on darwin
* Refactor: Removed else: pass statement
* Refactor: Removed unnecessary check
* added xattr to pyproject
* loggerd: switched to xatter module
* loggerd: removed unused module in xattr_cache.py
* UV: update uv.lock
* Update system/athena/athenad.py
* athenad: fixed blank lines
* loggerd: refactor of xattr_cache
* cleanup
---------
* fix getxattr no attribute on macOS
* try fixing missing ENOATTR on Linux
---------
Co-authored-by: Andrei Radulescu <andi.radulescu@gmail.com>
Co-authored-by: BrainLess <116778989+BrainLessPea@users.noreply.github.com> 
							
						 
						
							6 months ago  
				
					
						
							
							
								 
						
							
							
								aa1b790708 
								
							
								 
							
						 
						
							
							
								
								revert agnos 12  
							
							
 
							
						 
						
							6 months ago  
				
					
						
							
							
								 
						
							
							
								bbf37ae5c7 
								
									
								
							
								 
							
						 
						
							
							
								
								Reapply "Mypy: Got passing on macos ( #34591 )" ( #35126 )  
							
							... 
							
							
 
							
							* Mypy: Got passing on macos (#34591 )
* Mypy: Got mypy passing on macos
* common/realtime.py refactor
* Mypy: mypy passing on darwin
* Refactor: Removed else: pass statement
* Refactor: Removed unnecessary check
* added xattr to pyproject
* loggerd: switched to xatter module
* loggerd: removed unused module in xattr_cache.py
* UV: update uv.lock
* Update system/athena/athenad.py
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
* athenad: fixed blank lines
* loggerd: refactor of xattr_cache
* cleanup
---------
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
* fix getxattr no attribute on macOS
* try fixing missing ENOATTR on Linux
---------
Co-authored-by: BrainLess <116778989+BrainLessPea@users.noreply.github.com>
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com> 
							
						 
						
							6 months ago  
				
					
						
							
							
								 
						
							
							
								9d17c73f6b 
								
									
								
							
								 
							
						 
						
							
							
								
								avoid importing Raylib UI ( #35078 )  
							
							
 
							
						 
						
							6 months ago  
				
					
						
							
							
								 
						
							
							
								3ee2882093 
								
									
								
							
								 
							
						 
						
							
							
								
								ui: replace qt spinner with raylib ( #35059 )  
							
							... 
							
							
 
							
							* use raylib spinner
* remove qt spinner
* use wrapper, render spinner in thread
* english
* fix?
* match Qt font size more closely 
							
						 
						
							6 months ago  
				
					
						
							
							
								 
						
							
							
								e785026a98 
								
									
								
							
								 
							
						 
						
							
							
								
								feat(athenad): priority uploads ( #34856 )  
							
							... 
							
							
 
							
							Today, Firehose uploads and user-requested uploads from Connect are treated the same. This is not ideal behavior if the user wants to upload routes immediately for a bug report and the queue is full of uploads for Firehose. The workaround is to clear the queue and retry the upload from Connect.
This PR adds an optional `priority` to requested file uploads in `athenad`. By default, all requests are marked `Low`. However, if the caller wishes to mark their uploads as "more important," then the upload queue will prioritize those requests when uploading.
The only caveat to this PR is that we won't reorder files currently being uploaded. Most connections are quick enough to finish uploading max 4 files before polling the new high-priority items in the queue.
Closes https://github.com/commaai/openpilot/issues/34836 
**Verification**
Added test case to insert upload tasks with differing priorities. Polling the queue produces items in the correct order (smallest # to largest).
PR to mark Connect uploads as high priority: https://github.com/commaai/connect/pull/557 
---------
Co-authored-by: Cameron Clough <cameronjclough@gmail.com> 
							
						 
						
							8 months ago  
				
					
						
							
							
								 
						
							
							
								701868d5cd 
								
									
								
							
								 
							
						 
						
							
							
								
								firehose auto start + stats ( #34747 )  
							
							... 
							
							
 
							
							* don't need that
* stats
* lil more
* lil more
* cleanup
* tweaks
---------
Co-authored-by: Comma Device <device@comma.ai> 
							
						 
						
							8 months ago  
				
					
						
							
							
								 
						
							
							
								27b5a727e3 
								
							
								 
							
						 
						
							
							
								
								Revert "Mypy: Got passing on macos ( #34591 )"  
							
							... 
							
							
 
							
							This reverts commit b09b48130e 
							
						 
						
							9 months ago  
				
					
						
							
							
								 
						
							
							
								b09b48130e 
								
									
								
							
								 
							
						 
						
							
							
								
								Mypy: Got passing on macos ( #34591 )  
							
							... 
							
							
 
							
							* Mypy: Got mypy passing on macos
* common/realtime.py refactor
* Mypy: mypy passing on darwin
* Refactor: Removed else: pass statement
* Refactor: Removed unnecessary check
* added xattr to pyproject
* loggerd: switched to xatter module
* loggerd: removed unused module in xattr_cache.py
* UV: update uv.lock
* Update system/athena/athenad.py
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
* athenad: fixed blank lines
* loggerd: refactor of xattr_cache
* cleanup
---------
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com> 
							
						 
						
							9 months ago  
				
					
						
							
							
								 
						
							
							
								27c11eb597 
								
									
								
							
								 
							
						 
						
							
							
								
								athena upload: streaming file upload ( #34559 )  
							
							... 
							
							
 
							
							streaming file upload 
							
						 
						
							9 months ago  
				
					
						
							
							
								 
						
							
							
								9ec54f59c6 
								
									
								
							
								 
							
						 
						
							
							
								
								loggerd: switch logging from raw file format to zstd compressed files ( #34549 )  
							
							... 
							
							
 
							
							* switch logging from raw file format to zstd compressed files
* more zst suffix
* compress bootlog
* remove class RawFile
* Optimize ZstdFileWriter by adding input caching
* use ZSTD_compressStream2
* cleanup
* LOG_COMPRESSION_LEVEL=10
* space
* add zst suffix to LOGS_SIZE_RATE 
							
						 
						
							9 months ago  
				
					
						
							
							
								 
						
							
							
								9bc35c0919 
								
							
								 
							
						 
						
							
							
								
								Revert "athena upload: reduce memory usage and improve efficiency with streaming ( #34528 )"  
							
							... 
							
							
 
							
							This reverts commit 4c65f51a55 
							
						 
						
							9 months ago  
				
					
						
							
							
								 
						
							
							
								4c65f51a55 
								
									
								
							
								 
							
						 
						
							
							
								
								athena upload: reduce memory usage and improve efficiency with streaming ( #34528 )  
							
							... 
							
							
 
							
							* reduce memory usage and improve upload efficiency with streaming
* space 
							
						 
						
							9 months ago  
				
					
						
							
							
								 
						
							
							
								a5dd2ab2aa 
								
									
								
							
								 
							
						 
						
							
							
								
								athena: upload logs in parallel ( #34509 )  
							
							... 
							
							
 
							
							Co-authored-by: Comma Device <device@comma.ai> 
							
						 
						
							9 months ago  
				
					
						
							
							
								 
						
							
							
								79e52ea83d 
								
									
								
							
								 
							
						 
						
							
							
								
								FIREHOSE mode v0.1 ( #34496 )  
							
							... 
							
							
 
							
							* add toggle
* athena
* fix mypy 
							
						 
						
							9 months ago  
				
					
						
							
							
								 
						
							
							
								9cf02ca8db 
								
									
								
							
								 
							
						 
						
							
							
								
								Skip registration on newer devices ( #34316 )  
							
							
 
							
						 
						
							10 months ago  
				
					
						
							
							
								 
						
							
							
								cd6d9fee3f 
								
									
								
							
								 
							
						 
						
							
							
								
								Revert "athenad: fix thread safety issues in upload handing" ( #34224 )  
							
							... 
							
							
 
							
							Revert "athenad: fix thread safety issues in upload handing (#34199 )"
This reverts commit dcb3113c4b 
							
						 
						
							11 months ago  
				
					
						
							
							
								 
						
							
							
								dcb3113c4b 
								
									
								
							
								 
							
						 
						
							
							
								
								athenad: fix thread safety issues in upload handing ( #34199 )  
							
							... 
							
							
 
							
							* fix thread safety issues in upload handing
* remove cancelled_uploads
* remove None from current upload items & atomic updates 
							
						 
						
							11 months ago  
				
					
						
							
							
								 
						
							
							
								015aadd48c 
								
									
								
							
								 
							
						 
						
							
							
								
								Revert "athenad: fix thread safety issues in upload handing" ( #34198 )  
							
							... 
							
							
 
							
							Revert "athenad: fix thread safety issues in upload handing (#34084 )"
This reverts commit 7c101a40c8 
							
						 
						
							11 months ago  
				
					
						
							
							
								 
						
							
							
								7ec6a47c1e 
								
									
								
							
								 
							
						 
						
							
							
								
								athenad: optimize network state check in upload callback ( #34185 )  
							
							... 
							
							
 
							
							optimize network state check in upload callback 
							
						 
						
							11 months ago  
				
					
						
							
							
								 
						
							
							
								7c101a40c8 
								
									
								
							
								 
							
						 
						
							
							
								
								athenad: fix thread safety issues in upload handing ( #34084 )  
							
							... 
							
							
 
							
							* fix thread safety issues in upload handing
* remove cancelled_uploads 
							
						 
						
							11 months ago  
				
					
						
							
							
								 
						
							
							
								43807746ff 
								
									
								
							
								 
							
						 
						
							
							
								
								athenad: fix memory leak by closing Response objects ( #34101 )  
							
							... 
							
							
 
							
							* fix memory leak by closing Response
* use with 
							
						 
						
							11 months ago  
				
					
						
							
							
								 
						
							
							
								adb9560870 
								
									
								
							
								 
							
						 
						
							
							
								
								athenad: move last_scan outside the loop ( #34099 )  
							
							... 
							
							
 
							
							move last_scan outside the loop 
							
						 
						
							11 months ago  
				
					
						
							
							
								 
						
							
							
								b737e8472f 
								
									
								
							
								 
							
						 
						
							
							
								
								athenad: explicitly delete socket in getMessage ( #34098 )  
							
							... 
							
							
 
							
							explicitly delete socket in getMessage 
							
						 
						
							11 months ago  
				
					
						
							
							
								 
						
							
							
								957d39a5b6 
								
									
								
							
								 
							
						 
						
							
							
								
								athenad: close websocket before starting next loop iteration ( #34085 )  
							
							... 
							
							
 
							
							explicitly close websocket before starting next loop iteration 
							
						 
						
							11 months ago  
				
					
						
							
							
								 
						
							
							
								9ad2333546 
								
							
								 
							
						 
						
							
							
								
								athena: migrate old termux SSH port to new one  
							
							
 
							
						 
						
							1 year ago  
				
					
						
							
							
								 
						
							
							
								53f514cbd3 
								
									
								
							
								 
							
						 
						
							
							
								
								athena: update SSH port ( #33804 )  
							
							
 
							
						 
						
							1 year ago  
				
					
						
							
							
								 
						
							
							
								e04455cbaa 
								
									
								
							
								 
							
						 
						
							
							
								
								selfdrived: controlsd only does controls ( #33485 )  
							
							... 
							
							
 
							
							* selfdrived
* process replay
* lil more
* set the valids
* rename that 
							
						 
						
							1 year ago  
				
					
						
							
							
								 
						
							
							
								333c666a80 
								
							
								 
							
						 
						
							
							
								
								athena: use dongle ID on /persist/ when available ( #33259 )  
							
							... 
							
							
 
							
							* athena: use dongle ID on /persist/ when available
* comment
* test
* cleanup
old-commit-hash: 91db49b9bf 
							
						 
						
							1 year ago  
				
					
						
							
							
								 
						
							
							
								df13b36638 
								
							
								 
							
						 
						
							
							
								
								fix all codespell issues ( #33194 )  
							
							... 
							
							
 
							
							* bring back
* remove 2020 dictionary
old-commit-hash: 44c7144e1c 
							
						 
						
							1 year ago  
				
					
						
							
							
								 
						
							
							
								7b67994a05 
								
							
								 
							
						 
						
							
							
								
								use zstandard library ( #33110 )  
							
							... 
							
							
 
							
							* use zstandard
* run 10
* bye bye
* this was a little overzealous
* clean up
old-commit-hash: 1b3b5ab758 
							
						 
						
							1 year ago  
				
					
						
							
							
								 
						
							
							
								b0a8b3bc9d 
								
							
								 
							
						 
						
							
							
								
								uploader: compress with zstd ( #32736 )  
							
							... 
							
							
 
							
							* zstd uploader
* fix that
* fix name of function
* comment
* log failed
* fix comma_api_source for routes with both bz2 and zst rlogs
* TODO
* 10-14 achieves almost no benefit on qlogs in a few cases, but takes 2x the time
* these aren't written out
* regen: specify any list of sources
ooh this is pretty nice
* regen and process replay
* damn, actually we don't need all this (cool tho)
Revert "regen: specify any list of sources"
This reverts commit ceb0b4abed8c7da1dbd023b0023ddff296d624240768330e963718559c6c7dec7c39be 
							
						 
						
							1 year ago  
				
					
						
							
							
								 
						
							
							
								5fdbd73ba3 
								
							
								 
							
						 
						
							
							
								
								athenad: log failed upload items  
							
							... 
							
							
 
							
							old-commit-hash: add958bb08 
							
						 
						
							1 year ago  
				
					
						
							
							
								 
						
							
							
								3b8ed67aa3 
								
							
								 
							
						 
						
							
							
								
								remove navigation ( #32773 )  
							
							... 
							
							
 
							
							* remove navigation
* lil more
* fix cabana
* revert for now
* fix docs
* move that over
* lock
* rm assets
old-commit-hash: e491c9d964 
							
						 
						
							1 year ago  
				
					
						
							
							
								 
						
							
							
								008008b03a 
								
							
								 
							
						 
						
							
							
								
								Update to Python 3.12 ( #32548 )  
							
							... 
							
							
 
							
							* 3.12
* pprofile is broken
* use modified metadrivepy3-12
* 0.3.0 metadrive
* add metadrive/commaai git dependency
* metadrive git set
* pin sounddevice 0.4.6
* datetime.utcnow() deprecation
* poetry lock
* make datetime not aware
* poetry lock
* pin pytools
* google_crc32c wheel
* unpin sounddevice
* clean metadrive
* use python crc
* mypy
* 3.12.4
* allow python3.11
* test
* no pip
* poetry
* better
* better
* merge
* remove
* try
* test
* try  this
* snok
* python
* simpler
* setuptools
* lower
* try
* try
* work?
* ubuntu deps
* ubuntu
* try
* remove
* move
* remove this
* names
* Update .github/workflows/tools_tests.yaml
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* python<4
* <3.13
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
old-commit-hash: 148eaf8fa6 
							
						 
						
							1 year ago  
				
					
						
							
							
								 
						
							
							
								86b6103657 
								
							
								 
							
						 
						
							
							
								
								test_*.py files are no longer executable ( #32610 )  
							
							... 
							
							
 
							
							* test_*.py files are no longer executable
* cleanup empty lines
* update precommit
* fixme
* enable
* build
old-commit-hash: c59887c810 
							
						 
						
							1 year ago  
				
					
						
							
							
								 
						
							
							
								cc4f53e6c6 
								
							
								 
							
						 
						
							
							
								
								manager: move to system/ ( #32538 )  
							
							... 
							
							
 
							
							* manager: move to system/
* one more
old-commit-hash: accdade4cf 
							
						 
						
							1 year ago  
				
					
						
							
							
								 
						
							
							
								3358745103 
								
							
								 
							
						 
						
							
							
								
								ruff: enable UP  
							
							... 
							
							
 
							
							old-commit-hash: b2e4c64cf8 
							
						 
						
							1 year ago  
				
					
						
							
							
								 
						
							
							
								18970afb0e 
								
							
								 
							
						 
						
							
							
								
								athena: move to system/ ( #32488 )  
							
							... 
							
							
 
							
							* athena: move to system/
* slash
old-commit-hash: 3279dbeff7 
							
						 
						
							1 year ago