You can delete the subkey like

rKey = Registry.LocalMachine.OpenSubKey("Software", true);
rKey.DeleteSubKey("AppReg", true);

if you not clear look:
...