Harald Schäfer
103b4df18c
Log filenames: make tuples ( #35771 )
...
* make tuples
* spelling: this linter is hardcore
4 days ago
Shane Smiskol
ffc8ea5a86
LogReader: use file name constants ( #35765 )
...
use common
5 days ago
Shane Smiskol
e1fa04b678
Remove qcamera.ts.gz filename ( #35766 )
...
rm
5 days ago
Shane Smiskol
48892e339d
LogReader: remove testing closet source ( #35763 )
...
rm
5 days ago
Shane Smiskol
fbbad834f3
LogReader: cache internal source available ( #35761 )
...
* cache
* fix
* match behavioir
5 days ago
Shane Smiskol
278781e5af
LogReader: extend FileName ( #35760 )
...
extend filename
5 days ago
Shane Smiskol
43ad1754da
LogReader: fix broken test ( #35758 )
...
fix lr test
5 days ago
Shane Smiskol
4a5385a5b0
LogReader: support connect URLs ( #35757 )
...
* support connect
* clean up
5 days ago
Bruce Wayne
dbe172f7fd
Fragile xx code needs this
5 days ago
Shane Smiskol
618a25a612
LogReader: simplify sourcing logic and improve AUTO performance ( #35753 )
...
* sourcing supports any file type!
* stuff
* no camera for now
* i guess these are fine without
* rename
* get rid of these too!
* fix
* fix
* this is better
* start to clean up!
* better
* holy
holy
* clean up sources
* more robust
* working but needs some clean up
* clean up
* remove some trash
* nl
* auto_source can only return if it finds acceptable logs from sources
* double negative is confusing
* default
* list isn't hashable
* fix typing
* clean up
* speed up -- test_models got zst before bz2 in openpilotci, so do that (some segments have both bz2 and zst!)
* don't be a hero
* same behavior for now
5 days ago
Shane Smiskol
b50b351b15
LogReader: remove commaCarSegments selector ( #35750 )
...
* a source should not be a readmode... and readmode should be logtype
* fix that
* fixup
6 days ago
Shane Smiskol
862a816215
LogReader: add data endpoint option ( #35751 )
...
* add data endpoint option
* clean up
6 days ago
Shane Smiskol
239646b20b
Revert "clean up"
...
This reverts commit 5339a13c34
.
don't push to master, kids
6 days ago
Shane Smiskol
5339a13c34
clean up
6 days ago
Shane Smiskol
c553c1f872
LogReader: support passing list of sources ( #35749 )
...
* far too long
* this is a better experience
* no rename for now
6 days ago
Harald Schäfer
54da96dbdf
Route: add name format ( #35743 )
...
* needed for now
* TODO
* Add TODO
6 days ago
Shane Smiskol
632f7594a4
Ban time v2 ( #35744 )
...
* ban it!
* some legitimate blunders
* even more!
* this is from commaai/one
* here too
* this too
* ignore rest
* one liner
* Revert "one liner"
This reverts commit d96a162403
.
6 days ago
commaci-public
3a2c4a855a
[bot] Update Python packages ( #35726 )
...
* Update Python packages
* dep
* ref
* hint
---------
Co-authored-by: Vehicle Researcher <user@comma.ai>
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
1 week ago
Jason Young
b1972af6db
tools: fix log suffix for commaCarSegments v2 ( #35725 )
1 week ago
Adeeb Shihadeh
2b56a6c37e
Revert "tools: update to commaCarSegments v2 ( #35660 )"
...
This reverts commit 12a5d8c2db
.
2 weeks ago
Jason Young
12a5d8c2db
tools: update to commaCarSegments v2 ( #35660 )
2 weeks ago
Maxime Desroches
6a37d8a89e
fix framereader indent
1 month ago
Harald Schäfer
87a6e369aa
Framereader: minor cleanup ( #35577 )
...
* No wrapping
* unused test
* another list
* mypy
* cleaner
* Revert "cleaner"
This reverts commit ccc1446b9d
.
* mypy
1 month ago
Harald Schäfer
5f3d876aaa
model replay: framereader cache ( #35576 )
...
* Simpler cache version
* cachetools
* different LRU
* lint
* smaller
* just write LRU
* mypy
* same length
1 month ago
Harald Schäfer
d9b6c16037
Cleanup framereader ( #35513 )
...
* squash
* misc cleanup
* no LLM garbage
* misc fixes
* typo
* fix CI
* fix hints
* LLM soo wordy
* improve
1 month ago
Harald Schäfer
a8639d3feb
rgb is default ( #35467 )
...
* rgb is default
* change dummy default
2 months ago
Harald Schäfer
5505338ffb
model replay: less frames and less complexity ( #35427 )
...
* Revert "ci: faster model_replay (#34036 )"
This reverts commit 847a5ce1f3
.
* fix conflict
* trigger on test change
* zst
* give start and end frame
* unused flags
* no print
* whitespace
* fix plotting
* slice correct
* no print
* Just start from beginning
2 months ago
Trey Moen
19ad50a185
feat(route.py): add metadata, events retrieval ( #35261 )
...
* feat(route.py): add metadata, events retrieval
* whitespace
* raise for status
2 months ago
Trey Moen
60113632b4
feat(clip): delete get_metadata call ( #35229 )
...
* feat: delete get_metadata call
* no one else is using this now
2 months ago
Maxime Desroches
997a99926c
ci: overwrite previous comment for model_replay ( #35209 )
...
* less
* test
* fix
* cleanup
2 months ago
Trey Moen
f704d18a8b
feat(clip): title and metadata overlay ( #35099 )
...
* wip
* moar
* ensure inter is installed
* line len
* refactor
* dont need this
* no longer than
* show meta for 4s
3 months ago
Shane Smiskol
27d882cc0a
Revert "logreader.py: concurrent file existence checks" ( #34942 )
...
Revert "logreader.py: concurrent file existence checks (#34875 )"
This reverts commit e11b239b2e
.
4 months ago
Shane Smiskol
e652f435f9
max_lat_accel.py: use parallel processing ( #34936 )
...
* use run_across_segments
* disable tqdm
4 months ago
Dean Lee
e11b239b2e
logreader.py: concurrent file existence checks ( #34875 )
...
* concurrent file existence checks
* upper bound on parallel queries
---------
Co-authored-by: Shane Smiskol <shane@smiskol.com>
4 months ago
Shane Smiskol
65d667e60e
Revert "logreader: avoid repeated prompts in auto_strategy when rlogs are missing" ( #34919 )
...
Revert "logreader: avoid repeated prompts in auto_strategy when rlogs are mis…"
This reverts commit b8229ebca6
.
4 months ago
Dean Lee
b8229ebca6
logreader: avoid repeated prompts in auto_strategy when rlogs are missing ( #34890 )
...
* avoid repeated prompts in auto_strategy when rlogs are missing
* shorter
---------
Co-authored-by: Shane Smiskol <shane@smiskol.com>
4 months ago
Dean Lee
5cffaf5bb5
url_file.py: remove the unnecessary str() wrapping around the hexdigest() ( #34891 )
...
remove the unnecessary str() wrapping around the hexdigest()
4 months ago
Adeeb Shihadeh
071f8ba658
LogReader: add time_series helper
5 months ago
Adeeb Shihadeh
a30d3f7d72
test_onroad: cleanup with time series LogReader ( #34613 )
5 months ago
Adeeb Shihadeh
bab1254a02
LogReader: add time series helper ( #34608 )
...
* simple time series
* example
5 months ago
Dean Lee
9ec54f59c6
loggerd: switch logging from raw file format to zstd compressed files ( #34549 )
...
* switch logging from raw file format to zstd compressed files
* more zst suffix
* compress bootlog
* remove class RawFile
* Optimize ZstdFileWriter by adding input caching
* use ZSTD_compressStream2
* cleanup
* LOG_COMPRESSION_LEVEL=10
* space
* add zst suffix to LOGS_SIZE_RATE
6 months ago
Kacper Rączy
5dd1972f96
logreader: support filesystem DATA_ENDPOINT ( #34340 )
...
* Check if DATA_ENDPOINT is a dir
* Change url resolution to support joining dirs
7 months ago
Shane Smiskol
da2c70e097
Revert "LogReader: fix issue when your dns resolves all requests" ( #34229 )
...
Revert "LogReader: fix issue when your dns resolves all requests (#34089 )"
This reverts commit 7fc5040ed9
.
7 months ago
Maxime Desroches
e9246df02e
ci: faster unit tests ( #34161 )
...
* fast
* lint
* try
* clean
* this
* try even more
* more
* maybe
* what
* maybe?
* maybe
* try this
* fix
* fast?
* now cache?
* debug
* again...
* maybe
* NOW!
* revert, this is already enough (for now?)
8 months ago
Dean Lee
e19ecbf75c
CommaApi: use context manager for response handling ( #34118 )
...
use context manager for response handling
8 months ago
Justin Newberry
7fc5040ed9
LogReader: fix issue when your dns resolves all requests ( #34089 )
...
* terrible :(
* keep this spacing
8 months ago
Maxime Desroches
847a5ce1f3
ci: faster model_replay ( #34036 )
...
* cache draft
* fix
* fix
* fix
* better
* zst
* more
* try
* pool
* fix
* fix
* revert :C
* better
* cleanup
* no cache
* this too
8 months ago
Maxime Desroches
c995d5b9ae
ci: faster test_models ( #33941 )
...
* test
* try 4 runners
* try
* 100 for fun
* the fun is over
* try even less
9 months ago
Shane Smiskol
2af9f68147
LogReader: more specific exceptions ( #33914 )
...
* more specific logreader exceptions
* huh
* fix
9 months ago
Maxime Desroches
f11e5492f8
ci: keep old comment on model replay report ( #33759 )
...
keep old
10 months ago