Have a class that extends JDialog. It's initialized entirely on EDT (just in case). Now,
public PropsDialog (JFrame parentFrame) { super(parentFrame); // boring pack(); ...