Justin Newberry
9f1b72ac79
Replace multilogiterator ( #30980 )
1 year ago
Justin Newberry
eb09294fc2
segmentrangereader: support direct parsing ( #30973 )
...
* use correct source
* revert
* cleanup imports
* clean
* direct parsing
* rename
* move up
* fixes
* fix that
* better error message
1 year ago
Justin Newberry
fb994ae782
segmentrangereader: support more sources ( #30970 )
...
* support more sources
* remove this
1 year ago
Justin Newberry
be814ed447
SegmentRangeReader: log type selector ( #30960 )
...
* log type selector
* test this too
* and this
* invalid selector
* use strenum
* don't hardcode size
* oneline
1 year ago
Justin Newberry
cfb23eb2d1
segmentrangereader: support sort_by_time ( #30954 )
...
support sort-by-time
1 year ago
Justin Newberry
0d126e1e9e
SegmentRangeReader: new format for reading multiple segments ( #30940 )
...
* segment range reader
* rename that
* revert that
* cleanup
* revert this for now
* revert this for now
* Fix + test
* rm that
* rm that
* use for auto_fingerprint
* simpler
* for notebook too
* match numpy indexing
* just use numpy directly
* remove that
* spacing
* spacing
* use qlog for auto fingerprint
* add 'read mode'
* pass in read mode
* add test for modes
* numpy indexing
* fix that case
* more examples
* fix the notebook
* cleanup the notebook
* cleaner
* fix those
1 year ago
Justin Newberry
fba521ecc6
url_file: fix non-200 files being cached ( #30886 )
...
* fix + test
* fix unclosed
* easier to read
Co-authored-by: Shane Smiskol <shane@smiskol.com>
* fix that
---------
Co-authored-by: Shane Smiskol <shane@smiskol.com>
1 year ago
Adeeb Shihadeh
51a93cf9aa
fix unused
1 year ago
royjr
70624ffc81
dependency: remove pycurl package ( #30771 )
...
* Update qcomgpsd.py
* Update url_file.py
* remove pycurl
* requests -> urllib3
* unused
* redundant
* fix import
* Revert "requests -> urllib3"
This reverts commit 7ca39e6189
.
* headless
* fix trail
* use requests.exceptions.RequestException
* use fp.tell
* fix indents
* reorder imports
* change timeout
* fix debug timing
* remove exception
* add timeout
* missing headers
* move to constructor
* move import
* unused import
* fix debug
* try
* no retries
1 year ago
Greg Hogan
db35dcd0b5
replace common.file_helpers.mkdirs_exists_ok with python os.makedirs funtion ( #30618 )
...
replace common.file_helpers.mkdirs_exists_ok with python os.makedirs function
1 year ago
Justin Newberry
4086795c29
Pytest: more post-test path cleanup ( #30556 )
...
* test cleanup
* missed this one
* remove that
* static class
1 year ago
Kacper Rączy
c27e977475
URLFile: exception type for failed requests ( #30330 )
...
URLFileException for URLFile request errors
2 years ago
Greg Hogan
68acb26aa2
framereader: eliminate tempfile usage ( #30289 )
2 years ago
Greg Hogan
59e947dc6c
fix ffprobe on device ( #30286 )
...
* fix ffprobe on device
* use FileReader
* no more requests
2 years ago
Justin Newberry
1820b5f259
Proc Replay: cleanup iterable log typing ( #30261 )
...
* cleanup log typing
* use iterable
* fix those
* Cleanup
* cleanup
* missed that one
2 years ago
Greg Hogan
6f98a987af
vidindex improvements ( #30196 )
...
* vidindex improvements
* fix spelling
2 years ago
Greg Hogan
86b90a8ba2
filereader cleanup ( #30191 )
...
* filereader cleanup
* make name return url
* remove unused imports
2 years ago
Greg Hogan
f8e488f881
convert vidindex to python ( #30176 )
...
* convert vidindex to python
* fix whitespace
* corrupt file option
* fix up typings
* fix return type
* update framereader
* change length delimiter to uint32 value
* change length to uint32 value
* move url_file changes to separate PR
* cleanup caching
* revert whitespace change
* fix frame type param type
2 years ago
Justin Newberry
fa51bbc236
URLFile: don't cache non-existent file's lengths ( #30071 )
...
* urlfile empty
* simplify with mock
* better test name
* PR cleanup
* cleanup the length file
2 years ago
YassineYousfi
880157f5a6
framereader: add cache_dir argument ( #29904 )
...
* framereader: add cache_dir argument
* make it an env var
2 years ago
Greg Hogan
140a4ba558
importing auth_config.py should not have side effects ( #29893 )
...
import should not create directory
2 years ago
Justin Newberry
73eda51a11
System: use paths for download folders too ( #29818 )
...
* use paths for download folders too
* trailing slash
* reset that
2 years ago
Justin Newberry
4e69937d0d
Precommit: ensure executable bit is set ( #29784 )
...
* precommit ensure executable
* exclude tinygrad
* bump submodules
* exclude tinygrad globally
2 years ago
Justin Newberry
405d09714c
Tests: expand temporary directory helpers for more directories ( #29735 )
...
* create helpers for testing
* document it
* fix other tests
2 years ago
Justin Newberry
5dc7028f91
Tests: logmessaged reduce global state ( #29680 )
...
* reduce global state
* use a decorator here too
* use that one
* use base imports
* ipchandler in setup
* move to common dir
* move to helpers
* wip
* fix the decorator
2 years ago
Justin Newberry
dd9b0231c6
Tests: test_caching reduce global state ( #29681 )
2 years ago
Justin Newberry
1ee6ed4b16
Linter: remove pylint ( #29611 )
...
remove pylint
2 years ago
Dean Lee
21da5a216f
cpplint: add filter `build/include_subdir` ( #29585 )
2 years ago
Adeeb Shihadeh
a9626f95b6
add openpilot prefix to imports ( #29498 )
...
* add openpilot prefix to imports
* more
* more
* fix docs
* fix linter
* bump submodules
* fix patched tests
* update dynamic imports
* debug
* Revert "debug"
This reverts commit db5e13b991
.
* fix pm test
2 years ago
Adeeb Shihadeh
b11b14aff8
CI: enable PYTHONWARNINGS=error ( #29364 )
...
* CI: enable PYTHONWARNINGS=error
* fixes
* more ignore
* more modeld ignore
2 years ago
Justin Newberry
62c1e65924
Ruff: enable most of bugbear ( #29320 )
...
* added mutable default args
* most of the Bs
* add comment about lrucache
2 years ago
Justin Newberry
8793cbff40
Ruff: enable flake8-builtins ( #29315 )
...
* enable flake8-builtins
* replace any with contains
* fix typo in pack
* fix type
* format is from the parent module, has to be enabled
* item_id
* fix item_id
* disable for id since that's what the remote server returns
2 years ago
Justin Newberry
af3ed37c5c
Ruff: flake8 pie (misc lints) ( #29318 )
...
flake8 pie
2 years ago
Shane Smiskol
acc732efbb
replay: new demo route ( #29215 )
...
* new demo route
* replace other references (except gps test)
* Apply suggestions from code review
* it's 13 segments
2 years ago
Kacper Rączy
64377a88f9
process_replay: helpers ( #28367 )
...
* process_replay helper
* Refactor
* refactor check_enabled uses
* fix __init__
* noqa in __init__ imports
* Move compare_logs outside of process_replay
* Move save_logs to tools.lib.helpers
* Remove save_log from compare_logs
* fix lint issues
2 years ago
Adeeb Shihadeh
94eb215980
loggerd: move to system/ ( #27534 )
2 years ago
Adeeb Shihadeh
285fd56a1d
bootlog: add helper to get a bootlog by segment id
3 years ago
Adeeb Shihadeh
c6b749fb96
add pyside2 package ( #25602 )
3 years ago
Adeeb Shihadeh
6590fb2b93
pre-commit: add codespell ( #25571 )
3 years ago
Mitchell Goff
acbb230e0a
Update DATA_ENDPOINT default to data-raw.comma.internal ( #25597 )
3 years ago
Adeeb Shihadeh
e6e8607306
implement string representation for Bootlog
3 years ago
Adeeb Shihadeh
1139fe507b
Move selfdrive/hardware/ to system/ ( #24725 )
...
* move hardware to system/
* fix mypy
3 years ago
Lukas Petersson
86f73a507e
process replay: logreader as bytes ( #24610 )
...
* willem's changes
* classmethod for bytes
* submodules
* submodules
* Update tools/lib/logreader.py
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* add back files
* little cleanup
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
3 years ago
George Hotz
ea5b8cdfb1
nv12: encoderd avoids a full frame copy ( #24519 )
...
* rgb to nv12
* nv12 works (w memcpy)
* correct now
* no copy
* fix nv12 with fast debayer
* reverts of unused stuff
* ui use nv12
* comment out thumbnails for now
* rebase fix
* dm read nv12
* model read nv12
* fix ffmpeg encoder
* thumbnails from nv12
* replay to nv12
* python framereader support nv12
* remove hardcoded frame/buffer sizes
* fix build
* ffmpeg encoder fix buffers
* small cleanup
* reduce power usage test
* fix cpu usage test
* fix snapshot
* fix loggerd test
* bump cereal
Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: Joost Wooning <jwooning@gmail.com>
3 years ago
Willem Melching
194e5fdf1c
make normal logreader more robust ( #24577 )
3 years ago
ntegan1
07f7570840
Tools: allow using plotjuggler on local data ( #24473 )
...
local juggler
3 years ago
Dylan Herman
d2eef1955c
add mypy check for return-any ( #24379 )
...
* add mypy check for return-any
* remove unused import
* typing
* remove unnecessary variable typing
* cleanup
* cleanup
* bump submodules
* small fixes
* only a problem on mac
Co-authored-by: Willem Melching <willem.melching@gmail.com>
3 years ago
grekiki
17e33978cd
Mypy fixes for --check-untyped-defs ( #24372 )
...
more type fixes
3 years ago
Shane Smiskol
6163dd5ca0
URLFile: raise exception if remote URL doesn't exist when using cache ( #24432 )
...
* URLFile returns empty bytes if using cache and remote file doesn't exist
* better exception
* assert on cached files
3 years ago
ntegan1
bf269bd883
Tools: allow uncompressed logs ( #24471 )
3 years ago