fbbad834f3 
								
									
								
							
								 
							
						 
						
							
							
								
								LogReader: cache internal source available ( #35761 )  
							
							... 
							
							
 
							
							* cache
* fix
* match behavioir 
							
						 
						
							3 months ago  
				
					
						
							
							
								 
						
							
							
								618a25a612 
								
									
								
							
								 
							
						 
						
							
							
								
								LogReader: simplify sourcing logic and improve AUTO performance ( #35753 )  
							
							... 
							
							
 
							
							* sourcing supports any file type!
* stuff
* no camera for now
* i guess these are fine without
* rename
* get rid of these too!
* fix
* fix
* this is better
* start to clean up!
* better
* holy
holy
* clean up sources
* more robust
* working but needs some clean up
* clean up
* remove some trash
* nl
* auto_source can only return if it finds acceptable logs from sources
* double negative is confusing
* default
* list isn't hashable
* fix typing
* clean up
* speed up -- test_models got zst before bz2 in openpilotci, so do that (some segments have both bz2 and zst!)
* don't be a hero
* same behavior for now 
							
						 
						
							3 months ago  
				
					
						
							
							
								 
						
							
							
								862a816215 
								
									
								
							
								 
							
						 
						
							
							
								
								LogReader: add data endpoint option ( #35751 )  
							
							... 
							
							
 
							
							* add data endpoint option
* clean up 
							
						 
						
							3 months ago  
				
					
						
							
							
								 
						
							
							
								239646b20b 
								
							
								 
							
						 
						
							
							
								
								Revert "clean up"  
							
							... 
							
							
 
							
							This reverts commit 5339a13c34 
							
						 
						
							3 months ago  
				
					
						
							
							
								 
						
							
							
								5339a13c34 
								
							
								 
							
						 
						
							
							
								
								clean up  
							
							
 
							
						 
						
							3 months ago  
				
					
						
							
							
								 
						
							
							
								5dd1972f96 
								
									
								
							
								 
							
						 
						
							
							
								
								logreader: support filesystem DATA_ENDPOINT ( #34340 )  
							
							... 
							
							
 
							
							* Check if DATA_ENDPOINT is a dir
* Change url resolution to support joining dirs 
							
						 
						
							10 months ago  
				
					
						
							
							
								 
						
							
							
								da2c70e097 
								
									
								
							
								 
							
						 
						
							
							
								
								Revert "LogReader: fix issue when your dns resolves all requests" ( #34229 )  
							
							... 
							
							
 
							
							Revert "LogReader: fix issue when your dns resolves all requests (#34089 )"
This reverts commit 7fc5040ed9 
							
						 
						
							11 months ago  
				
					
						
							
							
								 
						
							
							
								7fc5040ed9 
								
									
								
							
								 
							
						 
						
							
							
								
								LogReader: fix issue when your dns resolves all requests ( #34089 )  
							
							... 
							
							
 
							
							* terrible :(
* keep this spacing 
							
						 
						
							11 months ago  
				
					
						
							
							
								 
						
							
							
								c995d5b9ae 
								
									
								
							
								 
							
						 
						
							
							
								
								ci: faster test_models ( #33941 )  
							
							... 
							
							
 
							
							* test
* try 4 runners
* try
* 100 for fun
* the fun is over
* try even less 
							
						 
						
							12 months ago  
				
					
						
							
							
								 
						
							
							
								937ed5f700 
								
							
								 
							
						 
						
							
							
								
								Add testing closet to LogReader source ( #33242 )  
							
							... 
							
							
 
							
							* add testing closet to logreader source
* check source availability
* use internal_source_available
old-commit-hash: 118932acd3 
							
						 
						
							1 year ago  
				
					
						
							
							
								 
						
							
							
								a17639bddb 
								
							
								 
							
						 
						
							
							
								
								logreader: skip internal source if connection refused ( #32418 )  
							
							... 
							
							
 
							
							* logreader: skip internal source if connection refused
* fix indentation
* fix spacing
* explicit ipv4 and tcp
old-commit-hash: 2a46d71fc8 
							
						 
						
							1 year ago  
				
					
						
							
							
								 
						
							
							
								4c7ad7f3b7 
								
							
								 
							
						 
						
							
							
								
								tools/lib: format code ( #31454 )  
							
							... 
							
							
 
							
							easier to read. pylint used to catch all this stuff, but it's mostly missing in ruff :'(
old-commit-hash: 0846175f44 
							
						 
						
							2 years ago  
				
					
						
							
							
								 
						
							
							
								1384c10fb0 
								
							
								 
							
						 
						
							
							
								
								logreader: skip internal source if not available ( #31400 )  
							
							... 
							
							
 
							
							* logreader: skip internal source if not available
* raise exception
* but only when appropriate
old-commit-hash: 667693b8c2 
							
						 
						
							2 years ago  
				
					
						
							
							
								 
						
							
							
								01eccef5de 
								
							
								 
							
						 
						
							
							
								
								filereader should use connection pool for file_exists ( #31158 )  
							
							... 
							
							
 
							
							* filereader should use connection pool for file_exists
* remove debug var
old-commit-hash: 6901aada14 
							
						 
						
							2 years ago  
				
					
						
							
							
								 
						
							
							
								a9676e7086 
								
							
								 
							
						 
						
							
							
								
								auto_source: optimize api calls and use head to determine if file exists ( #31025 )  
							
							... 
							
							
 
							
							* fast
* catch all
* source
* fix file_exists
* remove duplicate reset
* test multiple loops
* iterations
* cleanup imports
old-commit-hash: 2967cada71 
							
						 
						
							2 years ago  
				
					
						
							
							
								 
						
							
							
								e0469bdde6 
								
							
								 
							
						 
						
							
							
								
								filereader cleanup ( #30191 )  
							
							... 
							
							
 
							
							* filereader cleanup
* make name return url
* remove unused imports
old-commit-hash: 86b90a8ba2 
							
						 
						
							2 years ago  
				
					
						
							
							
								 
						
							
							
								16ec56398c 
								
							
								 
							
						 
						
							
							
								
								add openpilot prefix to imports ( #29498 )  
							
							... 
							
							
 
							
							* add openpilot prefix to imports
* more
* more
* fix docs
* fix linter
* bump submodules
* fix patched tests
* update dynamic imports
* debug
* Revert "debug"
This reverts commit db5e13b991a9626f95b6 
							
						 
						
							2 years ago  
				
					
						
							
							
								 
						
							
							
								7d6d3dc9ea 
								
							
								 
							
						 
						
							
							
								
								Ruff: flake8 pie (misc lints) ( #29318 )  
							
							... 
							
							
 
							
							flake8 pie
old-commit-hash: af3ed37c5c 
							
						 
						
							2 years ago  
				
					
						
							
							
								 
						
							
							
								a2d87101c7 
								
							
								 
							
						 
						
							
							
								
								Update DATA_ENDPOINT default to data-raw.comma.internal ( #25597 )  
							
							... 
							
							
 
							
							old-commit-hash: acbb230e0a 
							
						 
						
							3 years ago  
				
					
						
							
							
								 
						
							
							
								20670f0740 
								
							
								 
							
						 
						
							
							
								
								filereader better name for cd:/ replacement  
							
							... 
							
							
 
							
							old-commit-hash: a6b46c311e 
							
						 
						
							4 years ago  
				
					
						
							
							
								 
						
							
							
								c0e265b859 
								
							
								 
							
						 
						
							
							
								
								fix filereader cd:/ replacement  
							
							... 
							
							
 
							
							old-commit-hash: df35ebdceb 
							
						 
						
							4 years ago  
				
					
						
							
							
								 
						
							
							
								0b659ce9b6 
								
							
								 
							
						 
						
							
							
								
								eliminate xx filereader ( #23514 )  
							
							... 
							
							
 
							
							* eliminate xx filereader
* framereader cleanup
old-commit-hash: d5f4fdb1db 
							
						 
						
							4 years ago  
				
					
						
							
							
								 
						
							
							
								eca265120f 
								
							
								 
							
						 
						
							
							
								
								FrameIterator that uses 1+ GB less RAM ( #21687 )  
							
							... 
							
							
 
							
							old-commit-hash: 8f1806602c 
							
						 
						
							4 years ago  
				
					
						
							
							
								 
						
							
							
								d849706bc9 
								
							
								 
							
						 
						
							
							
								
								remove parallel url downloader  
							
							... 
							
							
 
							
							old-commit-hash: 927ef086f7 
							
						 
						
							5 years ago  
				
					
						
							
							
								 
						
							
							
								9c291968f6 
								
							
								 
							
						 
						
							
							
								
								Speedup URLFile ( #1888 )  
							
							... 
							
							
 
							
							* add parallel download support to URLFile
* make python 3.8 happy
* Fix chunk size
* Automatic number of threads
* No daemon threads in unlogger
* Cache length
* dont touch old filereader
* Remove debug info
* remove debug script
* Ignore type
old-commit-hash: c70700758d 
							
						 
						
							5 years ago  
				
					
						
							
							
								 
						
							
							
								738c3cca79 
								
							
								 
							
						 
						
							
							
								
								Tools: Storage API  ( #1161 )  
							
							... 
							
							
 
							
							* filereader
* support URLs in filereader, logreader
* unused
* use route files api; add auth file
* Implement browser auth
* Update readme, fix up cache paths
* Add tests, clear token on 401
* Factor out URLFile
* space
old-commit-hash: c4af05868b 
							
						 
						
							6 years ago  
				
					
						
							
							
								 
						
							
							
								99c5800ea5 
								
							
								 
							
						 
						
							
							
								
								merge in tools  
							
							... 
							
							
 
							
							old-commit-hash: 29ac3da7b8 
							
						 
						
							6 years ago