Joint Modeling of Heterogeneous Data with Deep Learning