Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat performance merge to track_sp_use_lk to enable realtime performance on realworld experiments. #37

Open
wants to merge 76 commits into
base: track_sp_use_lk
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
76 commits
Select commit Hold shift + click to select a range
e5ab1de
[Fix][Dockerfile]:Fix Libtorch version
Peize-Liu May 25, 2023
a78f6cd
[Feat][Dockerfile]:add jetpack35.3.1
Peize-Liu May 25, 2023
ea843e7
[Fix][Dockerfile]:orin_nx_docker image update
Peize-Liu May 26, 2023
3def34c
[Fix][Dockerfile]:modify for jetpack35.3.1
Peize-Liu May 26, 2023
1f55ee4
[Fix][Dockerfile]:support Orin Nx
Peize-Liu May 26, 2023
2f27b24
[Fix][Dockerfile]:modify dockerfile for pc compile
Peize-Liu May 27, 2023
33339bb
[Feat]: depth estimation node test on jetson orin new platform
Peize-Liu Aug 7, 2023
5c273e3
[Feat] add start docker script
Peize-Liu Aug 7, 2023
ce4b2d0
Merge branch 'main' into feat_jeston_orin_drone
Peize-Liu Aug 7, 2023
f42b87b
USE CXX 17 standard
xuhao1 Aug 8, 2023
a4dcb92
[Info] Modify info in start_docker.sh
Peize-Liu Aug 9, 2023
7dc3d20
Merge branch 'CXX17' into feat_test_cxx_17
Peize-Liu Aug 9, 2023
992c4c4
[Fix]:save calibration resualt pdf to evalutate reprojection error
Peize-Liu Aug 9, 2023
e67efc3
Merge branch 'develop' into feat_jeston_orin_drone
Peize-Liu Aug 9, 2023
26c70cf
[Fix]:Fix auto calibrate script failed in docker and modify output pa…
Peize-Liu Aug 10, 2023
a5f3b53
[Fix] Modify for new quadcam
Peize-Liu Aug 10, 2023
d2cafaa
[Config]:Add No 0 drone camera parameters
Peize-Liu Aug 12, 2023
1814e17
[Feat] make HITNET batch running in batch mode
Peize-Liu Aug 15, 2023
649bbd7
[Tool]: add quadcam tool to extract pictures
Peize-Liu Aug 15, 2023
e2a14b5
[Feat] add tool to evaluate onnx hit net and crenet performance
Peize-Liu Aug 16, 2023
5945440
[Fix] move development environment into docker
Peize-Liu Aug 16, 2023
add049e
[Fix] Dockerfile PC add onnxruntime python
Peize-Liu Aug 16, 2023
fc20925
[Feat] add quantization tool for hitnet and crestereo net
Peize-Liu Aug 21, 2023
96985bb
[Data] add net trainning sample data
Peize-Liu Aug 21, 2023
114770a
[Tool] add depth generate net calibration tool and evaluation tool
Peize-Liu Aug 23, 2023
92a02ee
Merge pull request #18 from D2SLAM-Fusion/fix_parrallel_net
Peize-Liu Sep 3, 2023
e2692f7
fix docker start file combined with git version
Peize-Liu Sep 7, 2023
b22bedb
fix depth estimation rely on local file and add optimize the configur…
Peize-Liu Sep 7, 2023
42d80bc
Fix quadcam tools rely on other task
Peize-Liu Sep 7, 2023
4dadfa5
add quadcam tools to convert high-resolution calibration file to low-…
Peize-Liu Sep 8, 2023
9211912
refine docker start script
Peize-Liu Sep 8, 2023
f8f4cf0
<feat>:
Jason-xy Sep 15, 2023
0849dee
<fix>: modify .gitignore to ignore python cache
Jason-xy Sep 18, 2023
eaafd23
add CICD for building docker image
Jason-xy Aug 25, 2023
9966831
add CICD for building docker image
Jason-xy Aug 25, 2023
85edde0
add CICD for building docker image
Jason-xy Aug 25, 2023
81bb75c
<fix>: container l4t version
Jason-xy Sep 19, 2023
8f361d0
Merge pull request #2 from D2SLAM-Fusion/fix/container_version
Jason-xy Sep 20, 2023
b787006
<fix>: path issue
Jason-xy Sep 27, 2023
ebd67ba
<fix>: dont forget to remove temp file
Jason-xy Sep 27, 2023
662a3a1
[Fix] make pc docker image source all packages when started
Peize-Liu Sep 21, 2023
bfede43
Fix: adjust for new quadcam drone
Peize-Liu Sep 28, 2023
ba5ea21
<fix> fix extrinsic parameter for drone1
Peize-Liu Sep 29, 2023
f490370
<feat> tensorrt depth for drone
Peize-Liu Sep 29, 2023
197fb93
Update docker-image.yml
Jason-xy Oct 13, 2023
11a8078
[Fix] fix dockerfile for pc compile bug
Peize-Liu Aug 7, 2023
ac8dce1
[Feat] add start docker script
Peize-Liu Aug 7, 2023
c97baaf
[Fix] fix quadcam calibration tool bug
Peize-Liu Aug 9, 2023
3c68280
add CICD for building docker image
Jason-xy Aug 25, 2023
e551dfa
add CICD for building docker image
Jason-xy Aug 25, 2023
17969fa
add CICD for building docker image
Jason-xy Aug 25, 2023
7e41e1d
add CICD for building docker image
Jason-xy Aug 25, 2023
53691b5
Update docker-image.yml
Jason-xy Oct 13, 2023
7c823e3
<feat> tensorrt depth for drone
Peize-Liu Sep 29, 2023
142c648
<Fix> fix service high cpu loading
Peize-Liu Oct 22, 2023
4852979
Fix: adopted to jetson orin
Peize-Liu Oct 23, 2023
a4c78da
fix: fix dump at start process
Peize-Liu Oct 23, 2023
e76df6c
Merge branch 'feat_tensorrt_depth' into develop
Peize-Liu Oct 25, 2023
1506f4b
<fix> fix quadcam depth can not show
Peize-Liu Oct 25, 2023
df1f53c
<Fix> modify drone0 debug setting
Peize-Liu Oct 26, 2023
c90089d
<fix> add spdlog lib in dockerfile
Peize-Liu Oct 26, 2023
04976e4
<fix>: fix lk track for fourfisheye not initialized
Peize-Liu Oct 29, 2023
b4cd019
<feat>: supperpoint infferenced under tensorrt raw support
Peize-Liu Nov 23, 2023
5304137
<feat>: netvlad infferenced under tensorrt raw support
Peize-Liu Nov 28, 2023
97630d6
fix: improve performance on real drone
Peize-Liu Jan 18, 2024
ed11bb4
Fix: good feature to track to compensate for Superpoint
Peize-Liu Jan 21, 2024
d703b76
fix: fix onlly good feature to track failed
Peize-Liu Jan 22, 2024
d1c5e06
version1: realdrone with sp
Peize-Liu Jan 22, 2024
104d0a6
feat: enbale use cpu to extract and track points
Peize-Liu Jan 22, 2024
ef304bf
feat: enbale use cpu to extract and track points
Peize-Liu Jan 22, 2024
8316319
v1.0 realfly: clean all printout only monitor frontend and backend speed
Peize-Liu Jan 23, 2024
c779446
v1.1 readly to fly version: but camera 2-3 side depth has some mismat…
Peize-Liu Jan 26, 2024
6b612c7
v2.0 exploration drone
Peize-Liu Jan 27, 2024
6d730f3
update rviz configuration
Peize-Liu Jan 30, 2024
8b329b0
new calibration parameter
Peize-Liu Feb 2, 2024
9627245
v2_cam_version
Peize-Liu Feb 6, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
99 changes: 99 additions & 0 deletions .github/workflows/docker-image.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,99 @@
name: Docker Image CI

on:
push:
branches: [ "main", "develop" ]
paths:
- '.github/workflows/docker-image.yml'
- '**.cpp'
- '**.h'
- 'docker/**'
pull_request:
branches: [ "main", "develop" ]
paths:
- '.github/workflows/docker-image.yml'
- '**.cpp'
- '**.h'
- 'docker/**'

jobs:

build-AMD64:

runs-on: [self-hosted, linux, x64]

steps:
-
name: Get current date
id: date
run: echo "::set-output name=today::$(date +'%Y-%m-%d_%H-%M')"
-
name: Checkout
uses: actions/checkout@v3
-
name: Login to Docker Hub
uses: docker/login-action@v3
with:
username: ${{ secrets.DOCKER_HUB_ACCOUNT }}
password: ${{ secrets.DOCKER_HUB_TOKEN }}
-
name: Set up Docker Buildx
uses: docker/setup-buildx-action@v2
-
name: Build and push
uses: docker/build-push-action@v3
with:
context: .
file: docker/Dockerfile
push: true
tags: |
hkustswarm/d2slam:${{ steps.date.outputs.today }}
hkustswarm/d2slam:latest
cache-from: type=local,src=/tmp/.buildx-cache
cache-to: type=local,dest=/tmp/.buildx-cache

build-ARM64:

runs-on: [self-hosted, linux, arm64]

steps:
-
name: Get current date
id: date
run: echo "::set-output name=today::$(date +'%Y-%m-%d_%H-%M')"
-
name: Checkout
uses: actions/checkout@v3
-
name: Login to Docker Hub
uses: docker/login-action@v3
with:
username: ${{ secrets.DOCKER_HUB_ACCOUNT }}
password: ${{ secrets.DOCKER_HUB_TOKEN }}
-
name: Set up Docker Buildx
uses: docker/setup-buildx-action@v2
-
name: Build-base and push
uses: docker/build-push-action@v3
with:
context: .
file: docker/Dockerfile.jetson_orin_base_35.3.1
push: true
tags: |
hkustswarm/d2slam:jetson_orin_base_35.3.1-${{ steps.date.outputs.today }}
hkustswarm/d2slam:jetson_orin_base_35.3.1
cache-from: type=local,src=/tmp/.buildx-cache
cache-to: type=local,dest=/tmp/.buildx-cache
-
name: Build-app and push
uses: docker/build-push-action@v3
with:
context: .
file: docker/Dockerfile.jetson
push: true
tags: |
hkustswarm/d2slam:jetson-${{ steps.date.outputs.today }}
hkustswarm/d2slam:jetson
cache-from: type=local,src=/tmp/.buildx-cache
cache-to: type=local,dest=/tmp/.buildx-cache
8 changes: 3 additions & 5 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -5,15 +5,11 @@ d2vins/build/
d2vins/cmake-build-debug/
d2vins/.idea/
d2common/build/
data_analysis/__pycache__/
d2pgo/build/
d2comm/build/
d2pgo/scripts/__pycache__/
d2pgo/scripts/notebooks/.ipynb_checkpoints/
d2pgo/scripts/pose_graph_partitioning/__pycache__/
d2pgo/scripts/notebooks/*.png
quadcam_depth_est/build/
quadcam_tools/__pycache__/
models/*.onnx
models/*.pb
models/*.trt
Expand All @@ -27,4 +23,6 @@ data_analysis/.ipynb_checkpoints/
d2pgo/posegraph-graphviz.*
d2pgo/scripts/notebooks/posegraph-graphviz.*
*/.DS_Store
.DS_Store
.DS_Store
**/__pycache__
**/*.py[cod]
21 changes: 11 additions & 10 deletions .vscode/c_cpp_properties.json
Original file line number Diff line number Diff line change
Expand Up @@ -7,21 +7,22 @@
},
"includePath": [
"/opt/ros/noetic/include/**",
"/home/xuhao/d2slam_ws/devel/include/**",
"/home/xuhao/d2slam_ws/src/D2SLAM/camera_models/include/**",
"/home/xuhao/d2slam_ws/src/vision_opencv/cv_bridge/include/**",
"/home/xuhao/d2slam_ws/src/D2SLAM/d2common/include/**",
"/home/xuhao/d2slam_ws/src/D2SLAM/d2frontend/include/**",
"/home/xuhao/d2slam_ws/src/vision_opencv/image_geometry/include/**",
"/home/xuhao/d2slam_ws/src/swarm_msgs/swarm_msgs/include/**",
"/home/xuhao/d2slam_ws/src/swarm_msgs/swarmcomm_msgs/include/**",
"/usr/include/**"
"/root/swarm_ws/devel/include/**",
"/root/swarm_ws/src/D2SLAM/camera_models/include/**",
"/root/swarm_ws/src/vision_opencv/cv_bridge/include/**",
"/root/swarm_ws/src/D2SLAM/d2common/include/**",
"/root/swarm_ws/src/D2SLAM/d2frontend/include/**",
"/root/swarm_ws/src/vision_opencv/image_geometry/include/**",
"/root/swarm_ws/src/swarm_msgs/swarm_msgs/include/**",
"/root/swarm_ws/src/swarm_msgs/swarmcomm_msgs/include/**",
"/usr/include/**",
"/usr/local/**"
],
"name": "ROS",
"intelliSenseMode": "gcc-x64",
"compilerPath": "/usr/bin/gcc",
"cStandard": "gnu11",
"cppStandard": "c++14",
"cppStandard": "c++17",
"configurationProvider": "ms-vscode.cmake-tools"
}
],
Expand Down
2 changes: 1 addition & 1 deletion camera_models/CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ cmake_minimum_required(VERSION 2.8.3)
project(camera_models)

set(CMAKE_BUILD_TYPE "Release")
set(CMAKE_CXX_STANDARD 14)
set(CMAKE_CXX_STANDARD 17)
set(CMAKE_CXX_FLAGS_RELEASE "-O3 -fPIC")

find_package(catkin REQUIRED COMPONENTS
Expand Down
Loading