I will give an overview of my work since 2004 on using data mining to perform novel science on large astronomical datasets, focusing on (1) Morphological galaxy classification in the Sloan Digital Sky Survey (SDSS) using artificial neural networks; (2) Star-galaxy separation in the SDSS using decision trees; (3) Photometric redshifts of SDSS and Galaxy Evolution Explorer quasars using k nearest...