<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Isaac Sim | Henry Kou</title><link>https://kenryhou2.github.io/tags/isaac-sim/</link><atom:link href="https://kenryhou2.github.io/tags/isaac-sim/index.xml" rel="self" type="application/rss+xml"/><description>Isaac Sim</description><generator>HugoBlox Kit (https://hugoblox.com)</generator><language>en-us</language><lastBuildDate>Mon, 29 Jun 2026 00:00:00 +0000</lastBuildDate><image><url>https://kenryhou2.github.io/media/icon_hu_da05098ef60dc2e7.png</url><title>Isaac Sim</title><link>https://kenryhou2.github.io/tags/isaac-sim/</link></image><item><title>DeformX</title><link>https://kenryhou2.github.io/projects/deformx/</link><pubDate>Mon, 29 Jun 2026 00:00:00 +0000</pubDate><guid>https://kenryhou2.github.io/projects/deformx/</guid><description>&lt;p&gt;DeformX is a co-simulation framework for deformable linear objects such as wires, cables, and ropes. The project addresses a common gap in robotic manipulation simulation: visually realistic DLO assets are often procedural and physically shallow, while physics-oriented approaches can simplify slender elastic objects into rigid-link chains or generic soft bodies that miss bending, twisting, and shear behavior.&lt;/p&gt;
&lt;p&gt;The framework integrates a dedicated Cosserat rod physics engine with NVIDIA Isaac Sim. The rod engine simulates DLO dynamics, self-collisions, and contact with arbitrary free-form meshes, while mesh skinning maps discrete rod deformation onto imported CAD models for high-fidelity visualization. This combination is intended to support both realistic visual rendering and principled physics in robot-learning pipelines.&lt;/p&gt;
&lt;p&gt;The paper demonstrates DeformX across synthetic data generation and policy learning for DLO manipulation, then validates visual and physical fidelity against real-world experiments. Fine-tuning Segment Anything Model 3 on DeformX-generated data improves real-image wire segmentation by 10.2% mAP@75, and a rope-swinging policy trained entirely in DeformX reaches a mean target-hitting error of 6.6 cm on a UR5e manipulator in real-world trials.&lt;/p&gt;
&lt;video controls muted playsinline preload="metadata" width="100%"&gt;
&lt;source src="hit_apple_trials.mp4" type="video/mp4"&gt;
Your browser does not support the video tag. &lt;a href="hit_apple_trials.mp4"&gt;Download the rope-swinging trials video&lt;/a&gt;.
&lt;/video&gt;
&lt;p&gt;&lt;em&gt;Rope-swinging policy trained in DeformX executing target-hitting trials on a UR5e manipulator.&lt;/em&gt;&lt;/p&gt;
&lt;p&gt;See the
and the
. The paper was accepted to
.&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;Keywords:&lt;/strong&gt; DeformX, deformable linear objects, DLO simulation, Cosserat rods, NVIDIA Isaac Sim, mesh skinning, robot manipulation, synthetic data generation, policy learning, sim-to-real transfer, SAM3, UR5e.&lt;/p&gt;</description></item><item><title>DeformX: A Versatile Co-Simulation Framework for Deformable Linear Objects</title><link>https://kenryhou2.github.io/publications/deformx-iros-2026/</link><pubDate>Mon, 29 Jun 2026 00:00:00 +0000</pubDate><guid>https://kenryhou2.github.io/publications/deformx-iros-2026/</guid><description>&lt;p&gt;
&lt;figure &gt;
&lt;div class="flex justify-center "&gt;
&lt;div class="w-full" &gt;
&lt;img alt="DeformX co-simulation framework cover"
srcset="https://kenryhou2.github.io/publications/deformx-iros-2026/deformX_cover_hu_593311ae7164abc4.webp 320w, https://kenryhou2.github.io/publications/deformx-iros-2026/deformX_cover_hu_84c39514929b7c0f.webp 480w, https://kenryhou2.github.io/publications/deformx-iros-2026/deformX_cover_hu_574cdb763019c7ff.webp 760w"
sizes="(max-width: 480px) 100vw, (max-width: 768px) 90vw, (max-width: 1024px) 80vw, 760px"
src="https://kenryhou2.github.io/publications/deformx-iros-2026/deformX_cover_hu_593311ae7164abc4.webp"
width="760"
height="420"
loading="lazy" data-zoomable /&gt;&lt;/div&gt;
&lt;/div&gt;&lt;/figure&gt;
&lt;/p&gt;
&lt;p&gt;DeformX is a co-simulation framework for deformable linear objects such as wires, cables, and ropes. The project addresses a common gap in robotic manipulation simulation: visually realistic DLO assets are often procedural and physically shallow, while physics-oriented approaches can simplify slender elastic objects into rigid-link chains or generic soft bodies that miss bending, twisting, and shear behavior.&lt;/p&gt;
&lt;p&gt;The framework integrates a dedicated Cosserat rod physics engine with NVIDIA Isaac Sim. The rod engine simulates DLO dynamics, self-collisions, and contact with arbitrary free-form meshes, while mesh skinning maps discrete rod deformation onto imported CAD models for high-fidelity visualization. This combination is intended to support both realistic visual rendering and principled physics in robot-learning pipelines.&lt;/p&gt;
&lt;p&gt;The paper demonstrates DeformX across synthetic data generation and policy learning for DLO manipulation, then validates visual and physical fidelity against real-world experiments. Fine-tuning Segment Anything Model 3 on DeformX-generated data improves real-image wire segmentation by 10.2% mAP@75, and a rope-swinging policy trained entirely in DeformX reaches a mean target-hitting error of 6.6 cm on a UR5e manipulator in real-world trials.&lt;/p&gt;
&lt;video controls muted playsinline preload="metadata" width="100%" poster="deformX_cover.png"&gt;
&lt;source src="hit_apple_trials.mp4" type="video/mp4"&gt;
Your browser does not support the video tag. &lt;a href="hit_apple_trials.mp4"&gt;Download the rope-swinging trials video&lt;/a&gt;.
&lt;/video&gt;
&lt;p&gt;&lt;em&gt;Rope-swinging policy trained in DeformX executing target-hitting trials on a UR5e manipulator.&lt;/em&gt;&lt;/p&gt;
&lt;p&gt;See the
and the
. The paper was accepted to
.&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;Keywords:&lt;/strong&gt; DeformX, deformable linear objects, DLO simulation, Cosserat rods, NVIDIA Isaac Sim, mesh skinning, robot manipulation, synthetic data generation, policy learning, sim-to-real transfer, SAM3, UR5e.&lt;/p&gt;
&lt;div class="highlight"&gt;&lt;pre tabindex="0" class="chroma"&gt;&lt;code class="language-bibtex" data-lang="bibtex"&gt;&lt;span class="line"&gt;&lt;span class="cl"&gt;&lt;span class="nc"&gt;@inproceedings&lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="nl"&gt;yang2026deformx&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span class="line"&gt;&lt;span class="cl"&gt; &lt;span class="na"&gt;title&lt;/span&gt; &lt;span class="p"&gt;=&lt;/span&gt; &lt;span class="s"&gt;{DeformX: A Versatile Co-Simulation Framework for
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span class="line"&gt;&lt;span class="cl"&gt;&lt;span class="s"&gt; Deformable Linear Objects}&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span class="line"&gt;&lt;span class="cl"&gt; &lt;span class="na"&gt;author&lt;/span&gt; &lt;span class="p"&gt;=&lt;/span&gt; &lt;span class="s"&gt;{Yang, Yi and Fei, Xiang and Wang, Lehong and Li, Chenhao
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span class="line"&gt;&lt;span class="cl"&gt;&lt;span class="s"&gt; and Dai, Zilin and Kou, Henry and Li, Lu and Choset, Howie}&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span class="line"&gt;&lt;span class="cl"&gt; &lt;span class="na"&gt;booktitle&lt;/span&gt; &lt;span class="p"&gt;=&lt;/span&gt; &lt;span class="s"&gt;{2026 IEEE/RSJ International Conference on Intelligent
&lt;/span&gt;&lt;/span&gt;&lt;/span&gt;&lt;span class="line"&gt;&lt;span class="cl"&gt;&lt;span class="s"&gt; Robots and Systems (IROS)}&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span class="line"&gt;&lt;span class="cl"&gt; &lt;span class="na"&gt;year&lt;/span&gt; &lt;span class="p"&gt;=&lt;/span&gt; &lt;span class="s"&gt;{2026}&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span class="line"&gt;&lt;span class="cl"&gt; &lt;span class="na"&gt;organization&lt;/span&gt; &lt;span class="p"&gt;=&lt;/span&gt; &lt;span class="s"&gt;{IEEE}&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;span class="line"&gt;&lt;span class="cl"&gt;&lt;span class="p"&gt;}&lt;/span&gt;
&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;</description></item></channel></rss>