* speed up sourcing but avoiding checking for existence of collected files already from previous sources
* clean up
* been meaning to make them return dicts
* no longer true
* no longer true
* clean up
* more
* more
* revert
* Reapply "LogReader: wrap events to cache which() (#35882)"
This reverts commit ba2dced54c.
* fix lr
* speed up
* clean up
* more
* should be fast
* clean up
* only supports Event
* rmrmr
* bye
* simple
* gix
* speed up lr
* lazy caching
* clean up
* it fast
* stash
* stash
* chatgpt code is bad as usual
* clean up
* clean up
* clean up
* clean up
* clean up
* clean up
* match behavior
* cmt
* sourcing supports any file type!
* stuff
* no camera for now
* i guess these are fine without
* rename
* get rid of these too!
* fix
* fix
* this is better
* start to clean up!
* better
* holy
holy
* clean up sources
* more robust
* working but needs some clean up
* clean up
* remove some trash
* nl
* auto_source can only return if it finds acceptable logs from sources
* double negative is confusing
* default
* list isn't hashable
* fix typing
* clean up
* speed up -- test_models got zst before bz2 in openpilotci, so do that (some segments have both bz2 and zst!)
* don't be a hero
* same behavior for now
* switch logging from raw file format to zstd compressed files
* more zst suffix
* compress bootlog
* remove class RawFile
* Optimize ZstdFileWriter by adding input caching
* use ZSTD_compressStream2
* cleanup
* LOG_COMPRESSION_LEVEL=10
* space
* add zst suffix to LOGS_SIZE_RATE
* buggin me
* no caps
* remove at least one level of indirection
* no recursion, remove a bunch of junk
* default is now allfault ??
* back
* fix tests
old-commit-hash: 5796bf12b6
* Pass filename explicitely when using azure container
* Do not update segments in test_processes
* openpilotci_source_zst
* Fix static analysisc
old-commit-hash: b5958ebb60
* count rlogs
* minimization changes
* cache to avoid duplicate checks
* no real point in checking qlogs to just show the warning
---------
Co-authored-by: Shane Smiskol <shane@smiskol.com>
old-commit-hash: 504dd4543d
* internal source list files like azure api
* messy but works
* no limit
* simpler
* clean up
* clean up
* clean up
* that's obvious
* better
* we need to unfortunately return a url, so best to take a naive approach for now
* todo
* fix
* clean up
old-commit-hash: b45caf4033
* fix :(
* test_sort_by_time
* this isn't required
* not slow, and just compare sorted
* messy
* works
* clean up
* clean up
* not here
* clean up
* clean up
* clean up
* makes network call
---------
Co-authored-by: Justin Newberry <justin@comma.ai>
old-commit-hash: e964c5944d
Shane Smiskol
Harald Schäfer
Adeeb Shihadeh
Dean Lee
commaci-public
Kacper Rączy
Jimmy
Hoang Bui
StefanLekanic-SYRMIA
Justin Newberry
Cameron Clough