Dean Lee
8f3fc699d4
loggerd: Initialize atomic variables to zero ( #33130 )
...
Initialize atomic variables in LoggerdState to zero
9 months ago
Harald Schäfer
e71ec4e8d7
Split cereal into cereal/msgq ( #32631 )
...
* squash
* fix doc
* compile device
* compile device
* Update ref
* add msgq to precommit exclusions
* No service ports
* fix compile
* address comments
* More comments
* Delete logger
* Update opendbc
* Linting
* bump msgq
11 months ago
Adeeb Shihadeh
a5766e2796
encoderd: get frame size over vipc ( #31276 )
...
* encoderd: get frame size over vipc
* bump cereal
* fix ffmpeg
* no print
1 year ago
Adeeb Shihadeh
2280ac50b7
uploader: restrict qcam upload on metered connctions ( #31047 )
...
* uploader: restrict qcam upload on metered connctions
* route requesting
* rename
* str
* cleanup
* strip dongle
* upload bookmarked segments
---------
Co-authored-by: Comma Device <device@comma.ai>
1 year ago
Dean Lee
3527c1da67
loggerd: c++ LoggerState ( #25869 )
...
* c++ LoggerState
* trigger ci
* trigger ci
* merge master
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
1 year ago
Justin Newberry
73eda51a11
System: use paths for download folders too ( #29818 )
...
* use paths for download folders too
* trailing slash
* reset that
2 years ago
Kacper Rączy
0bda43d71c
encoderd: fix crash when filename is null ( #29748 )
...
Use publish_name for thread name and debugging messages
2 years ago
Dean Lee
ac93902983
cpplint: add filter `whitespace/forcolon` ( #29582 )
...
whitespace/forcolon
2 years ago
Adeeb Shihadeh
e726505918
bump cereal ( #29561 )
2 years ago
Dean Lee
2d99521e75
cpplint: `build/include_what_you_use` ( #29556 )
...
* include_what_you_use
* remove comments
* include <memory>
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2 years ago
Vivek Aithal
81322a4805
[commabody] setup and run live stream encoders ( #29087 )
...
* op changes needed for body
* remove logmessaged callback
* add newlines
* add stream arg
* add stream_encoder to config
* supersets, avoid two encoderd
* fix recursive exit error
* fix loggerd crash
* add stream_encoderd cpu usage to test
* Update system/loggerd/loggerd.h
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* resolve comments
* stream_encoderd onroad to false
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2 years ago
Dean Lee
940954c13e
swaglog: enable type-checked against format string ( #29096 )
...
* check&fix fmt
* bump rednose
* correct format string
* bump rednose
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2 years ago
Dean Lee
c0c00e1997
loggerd: check `userFlag` outside the while loop ( #29095 )
...
* improve check userFlag
* rename to ServiceState
* setxattr once
2 years ago
Cameron Clough
98a30f10f4
deleter: preserve flagged segments ( #28814 )
2 years ago
Dean Lee
713d2ec586
loggerd/encoder: refactor constructors to take EncoderInfo as parameter ( #28921 )
...
* refactor constructors to take EncoderInfo as parameter
* remove last arg codec
* use macro to init function pointers
2 years ago
Dean Lee
36fe84ccdd
loggerd: pass `encoder_info` by reference ( #28694 )
2 years ago
Harald Schäfer
2453d3a04b
Encoderd: refactor msg getters and setters ( #28509 )
...
* Encoderd: refactor msg getters and setters
* whitespace
* whitespace
* whitespace
2 years ago
Harald Schäfer
ac45b77d3b
Encoderd: give every camera stream list of encoder streams ( #28480 )
...
* Compiles
* fixed something
* CLEANUP
* todo
* More cleanup
* Add TODO
* Update loggerd.cc
* remove write here too
2 years ago
Adeeb Shihadeh
94eb215980
loggerd: move to system/ ( #27534 )
2 years ago
Adeeb Shihadeh
2ecdb2857e
loggerd: rotate if segment length is >20% longer than expected ( #27193 )
...
* loggerd: rotate if segment length is >20% expected
* add that back
* comment
---------
Co-authored-by: Comma Device <device@comma.ai>
2 years ago
Jake Poznanski
c782e4d796
loggerd: fix length of ArrayPtr in handle_encoder_msg ( #26077 )
3 years ago
Dean Lee
568cc0f892
loggerd: remove 'enable' from struct LogCameraInfo ( #25052 )
...
remove enalbe
3 years ago
Dean Lee
748bbac344
loggerd: remove rotate_lock ( #24969 )
...
remove lock
3 years ago
Willem Melching
f49a9c9fd2
less TICI when not needed ( #24698 )
...
* less TICI when not needed
* fix process replay
* move reading voltages into hw abstraction layer
* Update selfdrive/hardware/tici/hardware.h
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* Update selfdrive/hardware/hw.h
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* Update selfdrive/hardware/base.h
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* rename init function
* Update selfdrive/athena/athenad.py
Co-authored-by: Robbe Derks <robbe.derks@gmail.com>
* Update selfdrive/boardd/boardd.cc
* Apply suggestions from code review
* Update selfdrive/thermald/thermald.py
* update ref
* fix alert width if all cameras are bad
* add ecam to test_loggerd
* bump cereal
* bump cereal
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Robbe Derks <robbe.derks@gmail.com>
3 years ago
George Hotz
0000ad2ac0
loggerd: Fix loggerd encode packet drops ( #24599 )
...
* hmm, try this
* hmm, try this
* rewrite handle_encoder_msg
* fix new logic
* add comments and an assert
* handle startup condition better
* handle restarts of encoderd
Co-authored-by: Comma Device <device@comma.ai>
3 years ago
George Hotz
94b9972eb7
encoderd: enable ( #24492 )
...
* enable encoderd
* correct enable line
* fix loggerd tests
* fix power draw and cpu tests
* correct cpu for encoderd
* fix a bug, video_writer is shared
* fix issue with not recording dcam
* add recording state
* wooo tests pass. encode id keeps counting
* core 3
* loggerd then encoderd
* stop loggerd first
* core 3 always online
* see the camera when we see encoder packet
* encoderd on small core uses 37%
* remove encoder logic from loggerd
* delete unit test that doesn't really make sense anymore
Co-authored-by: Comma Device <device@comma.ai>
3 years ago
George Hotz
bd0cc655fb
encoderd: support remote encoder behind env var ( #24490 )
...
* remote encoder
* remote encoder on PC, fix type
Co-authored-by: Comma Device <device@comma.ai>
3 years ago
George Hotz
2008db47c2
encoderd: make work on PC ( #24483 )
...
* don't use the codec in video_writer
* this produces broken videos for some reason
* bugfix
* refactor on the class
* works on device
* fix codec
* no codec enum
* fix pc
* move into dirs
* these includes also
* rename it ffmpegencoder
* add avcodec_close
Co-authored-by: Comma Device <device@comma.ai>
3 years ago
Willem Melching
77a6f3d034
delay bz2 compression from logging to uploading ( #24392 )
...
* remove log_name
* log without compression
* fix tests
* remove extension for bootlog
* another test fix
* uploader compresses
* also compress in athena
* only compress qlog
* more generic check in do_upload
* fix bootlog compression
* lower loggerd cpu usage
* dont link against bz2
* set core affinity to little cluster
* handle old files
3 years ago
George Hotz
0baa4c3e2a
loggerd: switch to v4l encoder try 2 ( #24380 )
...
* start v4l encoder
* v4l encoder starts
* start and stop
* fill in proper controls
* it dequeued a buffer
* getting bytes
* it made a video
* it does make files
* getting close
* ahh, so that's how dequeue works
* qcam works (no remuxing)
* remuxing works
* we just need to make shutdown and rollover graceful
* graceful destruction
* switch to polling
* should work now
* fix pc build
* refactors, stop properly
* touchups, remove a copy
* add v4l encoder to release
* inlcude file
* move writing to it's own thread
* fix minor memory leak
* block instead of dropping frames
* add counter, fix tests maybe
* better debugging and test print
* print file path in assert
* format string in test
* no more oversized qlogs
* match qcam
* touchups, remove omx encoder
* remove omx include files
* checked ioctl, better debugging, open by name
* unused import
* move linux includes to third_party/linux/include
* simple encoderd
* full packet
* encoderd should be complete
* lagging print
* updates
* name dq thread
* subset idx
* video file writing works
* debug
* potential bugfix
* rotation works
* iframe
* keep writing support
* ci should pass
* loggerd, not encoderd
* remote encoder code
* support remote encoder
* cereal to master, add encoderd
* header no longer required
* put that back there
* realtime
* lower decoder latency
* don't use queue for VisionIpcBufExtra, disable realtime again
* assert all written
* hmm simpler
* only push to to_write if we are writing
* assert timestamp is right
* use at and remove assert
* revert to queue
Co-authored-by: Comma Device <device@comma.ai>
3 years ago
George Hotz
0ac35a656a
loggerd: prereqs for deanlee loggerd omx encoder (try 2) ( #24252 )
...
* refactor encoders
* fix pc build
* buf_info
Co-authored-by: Comma Device <device@comma.ai>
3 years ago
George Hotz
dab978083b
loggerd: broadcast encoder data ( #24177 )
...
* encode data try 1
* fix pc build
* low quality compressed streamer with pyav
* nvidia streamer
* timestamp support
* fix latency measurement
* refactor
* camerastream updates
* fix linter
* compressed to vipc, clean
* remove print
* touchups
Co-authored-by: Comma Device <device@comma.ai>
3 years ago
George Hotz
cc8430b668
broadcast encode idx packets ( #24176 )
...
Co-authored-by: Comma Device <device@comma.ai>
3 years ago
Adeeb Shihadeh
652ef27a72
loggerd: less error logging
3 years ago
Dean Lee
4aa291c406
Use std::unique_ptr to manage memory ( #23168 )
...
* use unique_ptr
* trigger ci
* move down loggerdstate
3 years ago
Dean Lee
9decd3d8a2
util: move all functions into util namespace ( #23203 )
3 years ago
Adeeb Shihadeh
5f36b48199
loggerd: fix delayed exit from main thread
3 years ago
Adeeb Shihadeh
f71a03f967
increase loggerd per-cycle service limit to 200
3 years ago
Adeeb Shihadeh
baf1a77ca2
loggerd: don't let a single service clog up the main thread
3 years ago
Willem Melching
a2f32fd3e1
Clear loggerd locks once on boot ( #23060 )
...
* add test for clear_locks
* move to bootlog
* simplify test
3 years ago
Dean Lee
1d323e0fd6
loggerd: add test case for trigger_rotate ( #23038 )
...
* test rotate
* remove global LoggerdState
3 years ago
Dean Lee
75dd0d6296
loggerd: split loggerd.cc into three files
3 years ago
Adeeb Shihadeh
ea761cbbd5
loggerd: trigger rotate on frame id instead of frame count ( #22848 )
...
Co-authored-by: Comma Device <device@comma.ai>
4 years ago
Mayfield
5246f0231e
enable wshadow ( #22756 )
...
* enable wshadow (#22714 )
* fix replay
* more build fixes
Co-authored-by: Willem Melching <willem.melching@gmail.com>
4 years ago
Dean Lee
18caf3535b
loggerd: fix concurrency issues in sync encoders ( #22590 )
...
* sync_encoders
* add variable camera_synced
* cleanup
4 years ago
Adeeb Shihadeh
5b331fd6f5
don't set core affinity on PC ( #22706 )
4 years ago
Willem Melching
89f311714c
loggerd: set encodeIdx.valid if frame id is correct ( #22634 )
...
* loggerd: set encodeIdx.valid if frame id is correct
* check valid flag in test
* test cleanup
* bump cereal
4 years ago
Adeeb Shihadeh
76bd932cf5
loggerd: always run encoders ( #22649 )
...
* loggerd: always run encoders
* fix raw logger
* bump loggerd cpu usage
4 years ago
Adeeb Shihadeh
84de248fa7
tici: affine loggerd to efficiency cores ( #22581 )
4 years ago
Willem Melching
377fe84948
remove loggerd todo about encodeIdx decimation
4 years ago