Jianxiang Feng / 冯健祥

I am a final-year PhD student at Technical University of Munich (TUM) and the Institute of Robotic and Mechtronic (RM), German Aerospace Center (DLR). I am advised by Prof. Rudolph Triebel (DLR&KIT) and affiliated with Munich School of Data Science, where I worked with Prof. Stephan Günnemann. Recently, I start investigating Large/Foundation Models for Robotics as a senior research scientist at Agile Robots AG.

In general, my research interests reside in the intersection of robotics and machine learning with a primary focus on the trustworthy and adaptable learning ability of a robot in an open-world environment. In particular, aiming to equip a robot with introspective capabilities i.e., reliable confidence estimates and an awareness of the internal state of the system scuh as limitation of its knowledge and skills, I am intereseted in levaraging probabilistic Machine Learning methods such as Bayesian Neural Networks, Probabilistic Graphicial Models, flow-based Deep Generative Models, on

     - how to provide such introspection quantitatively: Uncertainty Estimation, Out-Of-Distribution detection, and so on;

     - how to exploit this capability for more trustworthy and cognitive learning-enabled robotic functionalities: perception, assembly planning, active learning, and so on.

I believe that this can lead to more explainable and ultimately safer autonomous robot systems.

P.S. The pronunciation of my first name "Jianxiang" is quite close to "Jensen" (yep, the well known "Jensen inequality" often used in ELBO derivation) but with a different ending :P.

Github     G. Scholar      LinkedIn     Twitter     Instagram

jianxiang.feng at tum dot de

profile photo
News

04.2024

    Our recent work KnowLoop, an uncertainty-based VLM failure detector for closed-loop LLM-based planners, got accepted to the ICRA 2024 Workshop.

01.2024

    Our ICRA 2024 Workshop Proposal titled "Back to the Future: Robot Learning Going Probabilistic" got accepted, thrilled to co-organize it! Stay tuned!

08.2023

    A paper on Normalizing Flows for Out-of-Distribution Detection got accepted in CoRL2023!

07.2023

    A paper on Graph Neural Networs and Assembly Seqeunce Planning got accepted in IROS2023.

06.2023

    Our aerial manipulation demo for kuka inovation award 2023 gained immense popularity in Automatica 2023 (press).

06.2023

    A paper of workshop on Robotics and AI: The Future of Industrial Assembly Tasks at RSS 2023 got accepted.

03.2023

    Won the 1st place in the discipline assist robot race of Cybathlon Challenge as part of EDAN team (press, video)

Videos

Pre-prints




Pre-prints
Multi-fingered Dynamic Grasping for Unknown Objects
Yannick Burkhardt*, Qian Feng*, Jianxiang Feng, Karan Sharma, Zhaopeng Chen, Alois Knoll,

arxiv / video

We present a dynamic grasping framework for unknown objects in this work, which uses a five-fingered hand with visual servo control and can compensate for external disturbances..






Publications
(*: equal contribution.)
Evaluating Uncertainty-based Failure Detection for Closed-Loop LLM Planners
Zhi Zheng*, Qian Feng, Hang Li, Alois Knoll, Jianxiang Feng*,
IEEE International Conference on Robotics and Automation (ICRA) 2024 Workshop on Back to the Future: Robot Learning Going Probabilistic.
webiste / poster (coming soon) / bibtex

We evaluated three different ways for quantifying the uncertainty of a VLM failure detector for closed-loop LLM planners.

Topology-Matching Normalizing Flows for Out-of-Distribution Detection in Robot Learning
Jianxiang Feng, Jongseok Lee, Simon Geisler, Stephan Günnemann, Rudolph Triebel,
7th Conference on Robot Learning (CoRL) 2023.
code / webiste / poster / spotlight presentation / bibtex

We propose to equip NFs with efficient but flexible base distributions to overcome the topological constraint for OOD detection in robot learning.

Efficient and Feasible Robotic Assembly Sequence Planning via Graph Representation Learning
Matan Atad*, Jianxiang Feng*, Ismael Rodríguez, Maximilian Durner, Rudolph Triebel,
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2023.
code / arXiv

A holistic graphical approach including a graph representation for product assemblies and a policy architecture, Graph Assembly Processing Network, dubbed GRACE to predict assembly sequences in a step-by-step manner.

Density-based Feasibility Learning with Normalizing Flows for Introspective Robotic Assembly
Jianxiang Feng*, Matan Atad*, Ismael Rodríguez, Maximilian Durner, Stephan Günnemann, Rudolph Triebel,
Workshop on Robotics and AI: The Future of Industrial Assembly Tasks, Robotics: Science and Systems (RSS) 2023.
code / arxiv / presentation video / slides / bibtex

A density-based method with normalizing flows for feasibility learning in Robotic Assembly based on only feasible examples.

Bayesian Active Learning for Sim-to-Real Robotic Perception
Jianxiang Feng, Jongseok Lee, Maximilian Durner, Rudolph Triebel,
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2022.
code / arXiv / poster / slides / presentation video / demo video / bibtex

An active learning pipeline to reduce annotation efforts of real data within a Sim-to-Real scenario based on deep Bayesian Neural Networks.

Introspective Robot Perception using Smoothed Predictions from Bayesian Neural Networks
Jianxiang Feng*, Maximilian Durner*, Zoltán-Csaba Márton, Ferenc Bálint-Benczédi, Rudolph Triebel,
The International Symposium of Robotics Research (ISRR) 2019.
arXiv / bibtex

A method for adaptive image classification based on fusing uncertainty estimates from Bayesian Neural Networks as unary potentials within a Conditional Random Field (CRF).

A Survey of Uncertainty in Deep Neural Networks
Jakob Gawlikowski, Cedrique Rovile Njieutcheu Tassi, Mohsin Ali, Jongseok Lee, Matthias Humt, Jianxiang Feng, Anna Kruspe, Rudolph Triebel, Peter Jung, Ribana Roscher, Muhammad Shahzad, Wen Yang, Richard Bamler, Xiaoxiang Zhu
Artificial Intelligence Review (2023): 1-77
arXiv / bibtex

A comprehensive overview of uncertainty estimation in neural networks, reviewing recent advances in the field, highlighting current challenges, and identifying potential research opportunities.

Trust Your Robots! Predictive Uncertainty Estimation of Neural Networks with Sparse Gaussian Processes
Jongseok Lee, Jianxiang Feng, Matthias Humt, Marcus G. Muller, Rudolph Triebel,
5th Conference on Robot Learning (CoRL) 2021.
code / video / bibtex

A probabilistic framework to obtain both reliable and fast uncertainty estimates for predictions with Deep Neural Networks (DNNs) based on Sparse Gaussian Processes.

Estimating Model Uncertainty of Neural Networks in Sparse Information Form
Jongseok Lee, Matthias Humt, Jianxiang Feng, Rudolph Triebel,
International Conference on Machine Learning (ICML) 2020.
code / bibtex

A sparse representation of model uncertainty for Deep Neural Networks (DNNs) where the parameter posterior is approximated with an inverse formulation of the Multivariate Normal Distribution (MND), also known as the information form.

Virtual Reality via Object Pose Estimation and Active Learning: Realizing Telepresence Robots with Aerial Manipulation Capabilities
Jongseok Lee, Ribin Radhakrishna Balachandran , Konstantin Kondak, Andre Coelho, Marco De Stefano, Matthias Humt, Jianxiang Feng, Tamim Asfour, Rudolph Triebel,
Field Robotics, 2023
video / bibtex

A novel teleoperation system for advancing aerial manipulation in dynamic and unstructured environments based on pose estimation pipelines for the industrial objects of both known and unknown geometries and an active learning pipeline.

Academic Services

2023

    Reviewer, CoRL.

2022

    Reviewer, ICRA, CoRL, IROS.

2020

    Reviewer, ICRA, IROS, ECAI.
Events

05.2024

    Co-Organizer, ICRA Workshop on Back to the Future: Robot Learning Going Probabilistic.

06.2023

    Team player, the aerial manipulation demo for kuka inovation award 2023 in Automatica 2023 (press).

03.2023

    Team player, the 1st place in the discipline assist robot race of Cybathlon Challenge as part of EDAN team (press, video)

06.2022

    Team player, EDAN demo at Automatica Exhibition 2022 ( press).

10.2022

    Co-Organizer, IROS Workshop on Probabilistic Robotics in the age of Deep Learning.
Brilliant People I worked with

08.2023

    Master Thesis Supervision at TUM: "Improving Sample Selection in Active Learning Using Graph Neural Networks" by Zhoumin Zhao, co-supervision with Simon Geisler.

06.2023

    Research Internship at DLR: "Automating Scene Graph Data Generation for Task and Motion Planning via Blenderproc" by Juan Diego Plaza Gomez, co-supervision with Samuel Bustamante and Dominik Winkelbauer.

03.2023

    Master Thesis Supervision at TUM: "Graph Neural Networks for Knowledge Transfer in Robotic Assembly Sequence Planning" by Matan Atad, co-supervision with Maximilian Durner, Ismael Rodriguezbrena.

11.2022

    Master Thesis Supervision at TUM: "Scene Graph Generation from Visual perception for Task and Motion Planning" by Mohit Kumar, co-supervision with Samuel Bustamante.


Link to the template. Do not scrape the HTML from this page itself, as it includes analytics tags that you do not want on your own website — use the github code instead. Also, consider using Leonid Keselman's Jekyll fork of this page.