Shane Smiskol
d5ce4b3085
SegmentRange: remove timestamp ( #32750 )
...
* add deprecation warning
* remove timestamp
* Update logreader.py
11 months ago
Shane Smiskol
3ede1e2a7c
LogReader: improve error messages ( #32747 )
...
* better error messages
* clean up
11 months ago
Shane Smiskol
04a93dd849
add zstd Python library ( #32731 )
...
* add zstd
* fix
* uploader
* logreader: zst support
* caps
* only logreader
11 months ago
Dean Lee
c64bca97ba
logreader.py: optimize event loading and sorting in _LogFileReader ( #32729 )
...
* improve logfilereader
* less changes
11 months ago
Justin Newberry
a819292073
logreader: fix auto source + interactive modes ( #31847 )
...
* interactive modes
* these exceptions don't matter
1 year ago
Shane Smiskol
e964c5944d
LogReader: fix sort by time and union types ( #31565 )
...
* fix :(
* test_sort_by_time
* this isn't required
* not slow, and just compare sorted
* messy
* works
* clean up
* clean up
* not here
* clean up
* clean up
* clean up
* makes network call
---------
Co-authored-by: Justin Newberry <justin@comma.ai>
1 year ago
Cameron Clough
995250ae49
use pyupgrade to update to new typing syntax ( #31580 )
...
* add pyupgrade hook
* run pyupgrade (pre-commit run -a)
* ruff --fix
* Revert "add pyupgrade hook"
This reverts commit 56ec18bb6b
.
* revert changes to third_party/
* manual type fixes
* explicit Optional wrapping capnp objects
1 year ago
Justin Newberry
16d1339553
test_logreader: test internal scenarios ( #31484 )
...
* test source scenario
* test source scenario
* fix
1 year ago
Justin Newberry
8aee0d2af2
test_logreader: test interactive mode + fix typo in AUTO_INTERACTIVE ( #31481 )
...
* fix spelling
* test interactive
* remove that
* test taht
* move that
1 year ago
Justin Newberry
33cf6bda9e
LogReader: add typing hints ( #31464 )
...
logreader typing
1 year ago
Justin Newberry
1436f576df
LogReader: retain old behavior for direct parsing of files ( #31419 )
...
* maintain exception
* test that head is not called
* annoying mock
* test with cache
1 year ago
Shane Smiskol
8fe9bc7a69
SegmentRange: simplify slice ( #31455 )
...
* simplify slicing
* rm
1 year ago
Shane Smiskol
0846175f44
tools/lib: format code ( #31454 )
...
easier to read. pylint used to catch all this stuff, but it's mostly missing in ruff :'(
1 year ago
Justin Newberry
d6762c3035
live_logreader to its own file ( #31436 )
...
own file
1 year ago
Justin Newberry
0a92c5bf96
LogReader: live_logreader helpers ( #31416 )
...
live helper
1 year ago
Greg Hogan
667693b8c2
logreader: skip internal source if not available ( #31400 )
...
* logreader: skip internal source if not available
* raise exception
* but only when appropriate
1 year ago
Justin Newberry
6010a39bf8
LogReader: skip file_exists check for comma_api ( #31251 )
...
* valid file
* missed this one
1 year ago
Justin Newberry
c782fbc34e
LogReader: add ```.filter``` ( #31222 )
...
add filter
1 year ago
Justin Newberry
7835f9cce0
LogReader: add tqdm back to run_across_segments ( #31216 )
...
tqdm
1 year ago
Justin Newberry
824ddffec8
CommaCarSegments: BIG Database! ( #31169 )
...
* sanetized selector
* god damn
* add to re
* slog branch
* slog
* source
* big
* not slog
* cleanup
* no space
* works!
* trigger
* main!
1 year ago
Justin Newberry
edd2428b60
LogReader: fail-fast on invalid segments ( #31152 )
...
* don't check all
* is
1 year ago
Justin Newberry
dd0c474e6c
LogReader: replace get_first_message with LogReader.first ( #31146 )
...
* first
* str
1 year ago
Justin Newberry
88dcaa51c4
LogReader: no redownloading on multiple iterations ( #31141 )
...
* no redownload
* sort
1 year ago
Justin Newberry
ac71c30ad5
auto_source: add commaCarSegments source ( #31137 )
...
add source
1 year ago
Justin Newberry
3d9b483e10
comma_api_source: fix qlogs ( #31136 )
...
fix qlogs
1 year ago
Justin Newberry
d574013d7b
LogReader: don't use route for max_segment ( #31129 )
...
* dont use route
* fix and cleanup
1 year ago
Justin Newberry
65490bb3c5
plotjuggler: auto fallback to qlogs with prompt ( #31110 )
...
* qlog fallback
* show a warning for that
* qlog fallback
* fix
* wording
1 year ago
Justin Newberry
389b8ca30d
add example of using the comma car segments database ( #31117 )
...
* add vin fingerprinting example
* perhaps!
* remove segment
* easier
1 year ago
Justin Newberry
caa9153974
CommaCarSegments: public database of segments for each platform ( #31114 )
...
* comma car segments
* comma car segments for test_models
* oneliner
Co-authored-by: Shane Smiskol <shane@smiskol.com>
* better name
* not used here
* sort
* remove print
* better comment
---------
Co-authored-by: Shane Smiskol <shane@smiskol.com>
1 year ago
Justin Newberry
2c86c023fe
sanitizer: sanitize vin number ( #31090 )
1 year ago
Justin Newberry
2967cada71
auto_source: optimize api calls and use head to determine if file exists ( #31025 )
...
* fast
* catch all
* source
* fix file_exists
* remove duplicate reset
* test multiple loops
* iterations
* cleanup imports
1 year ago
Justin Newberry
61fe705160
LogReader: fix plotjuggler not reading properly ( #31023 )
...
* fix plotjuggler
* simpler
* fix juggler
* fix that
1 year ago
Justin Newberry
7d400112df
LogReader: move opci to tools/lib ( #31021 )
...
move opci
1 year ago
Justin Newberry
0739d5d7b2
LogReader: support lists of identifiers ( #31020 )
...
* support lists of logs
* mark as slow instead
1 year ago
Justin Newberry
4da8d16514
LogReader: support only_union_types ( #31019 )
...
support only-union-types
1 year ago
Justin Newberry
3d73512c07
rename segmentrangereader to logreader ( #30981 )
...
* Replace multilogiterator
* replace logreader
* update readme
* fix from_Bytes
* new section
* reset before iter
* selector
* fix internal
* whitespace
1 year ago
Justin Newberry
9f1b72ac79
Replace multilogiterator ( #30980 )
1 year ago
Justin Newberry
1820b5f259
Proc Replay: cleanup iterable log typing ( #30261 )
...
* cleanup log typing
* use iterable
* fix those
* Cleanup
* cleanup
* missed that one
2 years ago
Adeeb Shihadeh
a9626f95b6
add openpilot prefix to imports ( #29498 )
...
* add openpilot prefix to imports
* more
* more
* fix docs
* fix linter
* bump submodules
* fix patched tests
* update dynamic imports
* debug
* Revert "debug"
This reverts commit db5e13b991
.
* fix pm test
2 years ago
Justin Newberry
62c1e65924
Ruff: enable most of bugbear ( #29320 )
...
* added mutable default args
* most of the Bs
* add comment about lrucache
2 years ago
Lukas Petersson
86f73a507e
process replay: logreader as bytes ( #24610 )
...
* willem's changes
* classmethod for bytes
* submodules
* submodules
* Update tools/lib/logreader.py
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* add back files
* little cleanup
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
3 years ago
Willem Melching
194e5fdf1c
make normal logreader more robust ( #24577 )
3 years ago
Lukas Petersson
1439867d16
Latency logger bad data robustness ( #24343 )
...
* robustness against bad data
* sort by time logreader
* loop until last frameid
3 years ago
Lukas Petersson
65fca83abe
Latency logging 2 ( #24058 )
...
* msg_order and gantt
* frameId in long/lat planner
* track frame id
* controls frame id
* graph tracked events
* graph json
* cloudlog timestamp
* c++ cloudlog
* add frame id
* bug fixes
* bug fixes
* frame id visionicp
* bug fixes and debug level
* timestamp log placement
* print timestamps in table
* translate events
* more logging
* bug fixes
* daemon boardd
* print logs with boardd
* more timestamp logs
* cleanup
* remove publish logs
* bug fix
* timestamp received
* timestamp received
* bug fixes
* use json lib
* ignore driver camera
* prep for new timestamp pipeline
* bug fix
* read new pipeline unfinnished
* read new pipeline
* bug fix
* add frame to controlsstate
* remove controlsstate
* print
* cleanup
* more cleanup + bug fix
* clock build issue
* remove unused imports
* format durations
* increase speed
* pr comments fixes
* conflicts
* set MANAGER_DAEMON for boardd
* clean script code
* bug fix + argparse
* remove rcv time
* bug fixes
* print without tabulate
* fix pre-commits
* plot gnatt
* color bug fix
* read without timestampextra
* bump panda
* mono time instead of frame id
* finnish script
* clean unused
* clean unused logging
* monotonic + json fixes
* del test
* remove whilelines
* bump laika
* cleanup
* remove deps
* logs nicer strings
* remove plotting from scirpt
* reset pipfile
* reset pipfile
* nicer strings
* bug fix
* bug fix
* pr comments cleaning
* remove plotting
* bug fix
* new demo route
* bump opendbc and panda
* cereal master
* cereal master
* script less komplex
* assertions
* matplotlib
* readme
* Update README.md
* graph html
* design fixes
* more code design
* Update common/logging_extra.py
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* whitespace
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* Update tools/latency_logger/latency_logger.py
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* pr comments
* bug fix
* readme + env once
* clean swaglog
* bug fix
* Update tools/latencylogger/README.md
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* revert
* revert
* clean swaglog with error
* remove typo file
* revert graph
* cereal
* submodules
* whitespaces
* update refs
Co-authored-by: Bruce Wayne <batman@workstation-openpilot2.internal>
Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
3 years ago
Adeeb Shihadeh
c95ec211e1
MultiLogIterator: add function to reset
3 years ago
Adeeb Shihadeh
1680f1e251
can_print_changes improvements
3 years ago
Greg Hogan
d5f4fdb1db
eliminate xx filereader ( #23514 )
...
* eliminate xx filereader
* framereader cleanup
3 years ago
Adeeb Shihadeh
bbb47dc860
MultiLogIterator: fix after adding sort_by_time
3 years ago
Adeeb Shihadeh
92f194decc
MultiLogIterator: remove wraparound mode ( #23360 )
3 years ago
Greg Hogan
9992ea1ae8
LogReader: add arg to sort by time ( #23346 )
...
* logreader optional sort by time
* robust logreader sort by time option
3 years ago