Back
History
Data Mining (Fall, 2013)
([MainPage|Back to homepage]) ==Information== * '''Course Number''': 081202B3 * '''To''': M. Sc. students of Department of Computer Science and Technology, Nanjing University. * '''Classroom''': <font color="red">207 Xian-II</font>, Xianlin Campus * '''Time''': 14:00 - 15:50, Tuesday * '''Office Hour''': 16:00 - 17:00, Tuesday (Rm 919, Computer Science Building) * '''Main Reference Books''': ** D. Hand, H. Mannila, P. Smyth. Principles of Data Mining. MIT Press, MA:Cambridge, 2001. ** J. Han, M. Kamber. Data Mining: Concepts and Techniques, 2nd edition. Morgan Kaufmann Publishers, 2006 ** I. H. Witten, E. Frank. Data Mining: Practical Machine Learning Tools and Techniques, 3rd edition. Morgan Kaufmann Publishers, 2011 ** P.-N. Tan, M. Steinbach, V. Kumar. Introduction to Data Mining, Addison-Wesley, 2006. ** E. Alpaydin. Introduction to Machine Learning, 2nd edition. MIT Press, 2010. ** C. M. Bishop. Pattern Recognition and Machine Learning, Springer, 2007. * '''Grading''': Final exam (30%) + assignments (70%) * '''TA''': Mr. [^http://lamda.nju.edu.cn/huangsj|Sheng-Jun Huang] and Mr. [^http://lamda.nju.edu.cn/daq|Qing Da] * '''Final Exam''': <font color='red'>10:00 - 12:00, Jan. 3, 2014, 仙1-206,207</font> ==Assignments== '''Please follow the introductions in the TA page: [http://lamda.nju.edu.cn/daq/dm13.ashx]''' Assignment 1 (10%): Write a report on data mining applications <s>Due on 23:59:59 Sep. 24, 2013 </s> Assignment 2 (5%): Implement a Decision Tree learning algorithm <s>Due on 23:59:59 Oct. 8, 2013 </s> Assignment 3 (5%): Implement a Naive Bayes classification algorithm <s>Due on 23:59:59 Oct. 15, 2013</s> Assignment 4 (5%): Implement a Random Forest and an AdaBoost algorithms <s>Due on 23:59:59 Oct. 22, 2013</s> Assignment 5 (5%): Implement a k-Means clustering algorithm <s>Due on 23:59:59 Oct. 29, 2013</s> Assignment 6 (20%): Mining from a real-world data set (1) <s>Due on 23:59:59 Nov. 19, 2013</s> Assignment 7 (20%): Mining from a real-world data set (2) <s> Due on 23:59:59 Dec. 17, 2013</s> ==Schedule and Lecture slides== <table border="0" cellspace="10"> <tr valign="top"><td> '''Sep. 17''': Introduction [{UP}course_dm13ms/Lecture1.pdf|(Download PDF)] </td><td></td> <td> Reading material:<br/> Z.-H. Zhou. [^http://cs.nju.edu.cn/zhouzh/zhouzh.files/publication/aij03.pdf|Three perspectives of data mining]. Artificial Intelligence, 2003, 143(1): 139-146.<br/> H.-P. Kriegel, et al. [^http://cs.nju.edu.cn/zhouzh/zhouzh.files/course/dm/reading/reading01/hans_dmkd07.pdf|Future trends in data mining]. Data Mining and Knowledge Discovery, 2007, 15(1): 87-97.<br/> Q. Yang and X. Wu. [^http://cs.nju.edu.cn/zhouzh/zhouzh.files/course/dm/reading/reading01/yang_ijitdm06.pdf|10 challenging problems in data mining research]. International Journal of Information Technology & Decision Making, 2006, 5(4): 597-604. </td> </tr> <tr><td> </td></tr> <tr><td valign="top"> '''Sep. 24''': Data, Measurements, and Visualization [{UP}course_dm13ms/Lecture2.pdf|(Download PDF)] </td><td></td> <td> Reading material:<br/> M. C. F. de Oliveira and H. Levkowitz. [^http://cs.nju.edu.cn/zhouzh/zhouzh.files/course/dm/reading/reading03/deOliveira_tvcg03.pdf|From visual data exploration to visual data mining: A survey]. IEEE TVCG, 2003, 9(3): 378-394.<br/> H. Liu, F. Hussain, C. L. Tan, and M. Dash. [^http://cs.nju.edu.cn/zhouzh/zhouzh.files/course/dm/reading/reading03/liu_dmkd02.pdf|Discretization: An enabling technique]. DMKD, 2002, 6(4): 393-423.<br/> J. Dougherty, R. Kohavi, M. Sahami. [^http://robotics.stanford.edu/users/sahami/papers-dir/disc.pdf|Supervised and unsupervised discretization of continuous features]. In Proceedings of ICML'95, 194-202, Tahoe City, CA.<br/> X. Zhu and X. Wu. [^http://cs.nju.edu.cn/zhouzh/zhouzh.files/course/dm/reading/reading03/zhu_airev04.pdf|Class noise vs. attribute noise: A qualitative study of their impacts]. AI Review, 2004, 22(3-4): 177-210.<br/> Link: [^http://datavlab.org/datavjs/|A javascript for simple data visualization]<br/> </td> </tr> <tr><td valign="top"> Machine Learning I : Decision Tree [{UP}course_dm13ms/Lecture3.pdf|(Download PDF)] </td><td></td> <td> Reading material:<br/> [^http://www.realtechsupport.org/UB/MRIII/papers/MachineLearning/Alppaydin_MachineLearning_2010.pdf|Chapters 9 of Introduction to Machine Learning] (E. Alpaydin, MIT Press, 2010).<br/> R. Quinlan. [^http://www.dmi.unict.it/~apulvirenti/agd/Qui86.pdf|Induction of decision trees]. MLJ, 1:81-106, 1986. </td> </tr> <tr><td> </td></tr> <tr><td valign="top"> '''Oct. 8''': Machine Learning II : Principle of Learning [{UP}course_dm13ms/Lecture4.pdf|(Download PDF)] </td><td></td> <td> Reading material:<br/> [^http://www.realtechsupport.org/UB/MRIII/papers/MachineLearning/Alppaydin_MachineLearning_2010.pdf|Chapter 2 of Introduction to Machine Learning] (E. Alpaydin, MIT Press, 2010).<br/> L. Valiant. [^http://www.mpi-inf.mpg.de/~mehlhorn/SeminarEvolvability/ValiantLearnable.pdf|A theory of the learnable]. Communication of the ACM, 27(11):1134-1142, 1984. </td> </tr> <tr><td valign="top"> Machine Learning III : Bayesian Classifiers [{UP}course_dm13ms/Lecture5.pdf|(Download PDF)] </td><td></td> <td> Reading material:<br/> D. Heckerman. [^http://cs.nju.edu.cn/zhouzh/zhouzh.files/course/dm/reading/reading04/heckerman_dmkd97.pdf|Bayesian networks for data mining]. DMKD, 1997, 1(1): 79-119.<br/> H. Zhang. [^http://www.aaai.org/Papers/FLAIRS/2004/Flairs04-097.pdf|The Optimality of Naive Bayes]. FLAIRS Conference 2004.<br/> F. Zheng and G. I. Webb. [^http://www.csse.monash.edu.au/~webb/Files/ZhengWebb05.pdf|A Comparative Study of Semi-naive Bayes Methods in Classification Learning]. In AusDM'05, 141-156.<br/> </td> </tr> <tr><td> </td></tr> <tr><td valign="top"> '''Oct. 15''': Machine Learning IV: Ensemble Methods [{UP}course_dm13ms/Lecture6.pdf|(Download PDF)] </td><td> </td><td> Reading material:<br/> L. Breiman. [^http://oz.berkeley.edu/users/breiman/randomforest2001.pdf|Random Forest]. Machine Learning 45 (1): 5–32.<br/> Z.-H. Zhou. Ensemble Methods: Foundations and Algorithms, Boca Raton, FL: Chapman & Hall/CRC, 2012. ([^http://cs.nju.edu.cn/zhouzh/zhouzh.files/publication/emfa-ch2.pdf|Chapter 2: Boosting]).<br/> E. Bauer and R. Kohavi. [^http://robotics.stanford.edu/~ronnyk/vote.pdf|An Empirical Comparison of Voting Classi cation Algorithms: Bagging, Boosting, and Variants]. Machine Learning, 1999, 36(1):105-139. </td> </tr> <tr><td> </td></tr> <tr><td valign="top"> '''Oct. 22''': Machine Learning V: Unsupervised learning [{UP}course_dm13ms/Lecture7.pdf|(Download PDF)] </td><td></td> <td> Reading material:<br/> [^http://www.realtechsupport.org/UB/MRIII/papers/MachineLearning/Alppaydin_MachineLearning_2010.pdf|Chapter 8 and 7 of Introduction to Machine Learning] (E. Alpaydin, MIT Press, 2010).<br/> V. Estivill-Castro. [^http://cs.nju.edu.cn/zhouzh/zhouzh.files/course/dm/reading/reading06/estivill-castro_sigkddexp02.pdf|Why so many clustering algorithms - a position paper]. SIGKDD Explorations, 2002, 4(1): 65-75.<br/> R. Xu and D. Wunsch II. [^http://cs.nju.edu.cn/zhouzh/zhouzh.files/course/dm/reading/reading06/xu_tnn05.pdf|Survey of clustering algorithms]. IEEE Transactions on Neural Networks, 2005, 16(3): 645-678.</br> C. Elkan. [^http://cseweb.ucsd.edu/~elkan/kmeansicml03.pdf|Using the Triangle Inequality to Accelerate k-Means]. ICML'03, 147-153. </td> </tr> <tr><td> </td></tr> <tr><td valign="top"> '''Oct. 29''': Machine Learning VI: Linear Models [{UP}course_dm13ms/Lecture8.pdf|(Download PDF)] </td><td></td> <td> Reading material:<br/> Chapters 3, 4, 6, and 7 of Pattern Recognition and Machine Learning (C. M. Bishop, Springer, 2007) <br/> C. J. C. Burges. [^http://cs.nju.edu.cn/zhouzh/zhouzh.files/course/dm/reading/reading04/burges_dmkd98.pdf|A tutorial on support vector machines for pattern recognition]. DMKD, 1998, 2(2): 121-167.<br/> K.-R. Müller, S. Mika, G. Rätsch, K. Tsuda, and B. Schölkopf. [^http://cs.nju.edu.cn/zhouzh/zhouzh.files/course/dm/reading/reading04/muller_tnn01.pdf|An introduction to kernel-based learning algorithms]. IEEE TNN, 2001, 12(2): 181-201. </td> </tr> <tr><td> </td></tr> <tr><td valign="top"> '''Nov. 5''': Machine Learning VII: Neural Networks and Nearest Neighbors [{UP}course_dm13ms/Lecture9.pdf|(Download PDF)] </td><td></td> <td> Reading material:<br/> A. Roy. [^http://cs.nju.edu.cn/zhouzh/zhouzh.files/course/dm/reading/reading04/roy_sigkddexp00.pdf|Artificial neural networks - A science in trouble]. SIGKDD Explorations, 2000, 1(2): 33-38.</br> G. E. Hinton and R. R. Salakhutdinov. [^http://www.cs.toronto.edu/~hinton/science.pdf|Reducing the dimensionality of data with neural networks]. Science, 313:504-507, 2006. A. Andoni and P. Indyk. [^http://people.csail.mit.edu/indyk/p117-andoni.pdf|Near-Optimal Hashing Algorithms for Approximate Nearest Neighbor in High Dimensions]. CACM, 2008, 51(1): 117-121. </td> </tr> <tr><td valign="top"> Experiment Design [{UP}course_dm13ms/LectureA.pdf|(Download PDF)] </td><td></td> <td></td> </tr> <tr><td> </td></tr> <tr><td valign="top"> '''Nov. 12''': Data Mining I: Feature Processing [{UP}course_dm13ms/Lecture10.pdf|(Download PDF)] </td><td></td> <td> Reading material:<br/> A. L. Blum and P. Langley. [^http://cs.nju.edu.cn/zhouzh/zhouzh.files/course/dm/reading/reading03/blum_aij97.pdf|Selection of relevant features and examples in machine learning]. AIJ, 1997, 97(1-2): 245-271.<br/> I. Guyon and A. Elisseeff. [^http://cs.nju.edu.cn/zhouzh/zhouzh.files/course/dm/reading/reading03/guyon_jmlr03.pdf|An introduction to variable and feature selection]. Journal of Machine Learning Research, 2003, 3: 1157-1182.<br/> [^http://www.realtechsupport.org/UB/MRIII/papers/MachineLearning/Alppaydin_MachineLearning_2010.pdf|Chapter 6 of Introduction to Machine Learning] (E. Alpaydin, MIT Press, 2010).<br/> J. B. Tenenbaum, V. de Silva and J. C. Langford. [^http://web.mit.edu/cocosci/Papers/sci_reprint.pdf|A Global Geometric Framework for Nonlinear Dimensionality Reduction]. Science, 2000, 290:2319-2322. </td> </tr> <tr><td> </td></tr> <tr><td valign="top"> '''Nov. 19''': Data Mining II: Handling Large Scale Data [{UP}course_dm13ms/Lecture11.pdf|(Download PDF)] </td><td></td> <td> Reading material:<br/> M. Banko and E. Brill. [^http://research.microsoft.com/pubs/66840/acl2001.pdf|Scaling to very very large corpora for natural language disambiguation]. ACL'01.<br/> J. Dean and S. Ghemawat. [^http://static.usenix.org/event/osdi04/tech/full_papers/dean/dean.pdf|Mapreduce: Simplified data processing on large clusters]. OSDI'04.<br/> B. Panda, et al. [^http://www.bayardo.org/ps/vldb2009.pdf|PLANET: Massively parallel learning of tree ensembles with MapReduce]. VLDB'09.<br/> J. Friedman. [^http://www.salford-systems.com/doc/StochasticBoostingSS.pdf|Stochastic gradient boosting]. Computational Statistics & Data Analysis, 2002, 38(4):367-378.<br/> J. Lin and A. Kolcz. [^http://www.umiacs.umd.edu/~jimmylin/publications/Lin_Kolcz_SIGMOD2012.pdf|Large-Scale Machine Learning at Twitter]. SIGMOD'12. <br/> </td> </tr> <tr><td> </td></tr> <tr><td valign="top"> '''Nov. 26''': Assignment Discussion </td><td></td> <td> </td> </tr> <tr><td> </td></tr> <tr><td valign="top"> '''Dec. 3''': Data Mining III: Mining Linkage Data [{UP}course_dm13ms/Lecture12.pdf|(Download PDF)] </td><td></td> <td> Reading material:<br/> L. Getoor and C. Diehl. [^http://www.cs.umd.edu/~getoor/Publications/getoor-kddexp05.pdf|Link mining: A survey]. SIGKDD Explorations, 7(2):3-12, 2005.<br/> L. Page, et al. [^http://ilpubs.stanford.edu:8090/422/1/1999-66.pdf|The PageRank citation ranking: Bringing order to the web]. Technic report, 1997. </td> </tr> <tr><td> </td></tr> <tr><td valign="top"> '''Dec. 10''': Data Mining IV: Information Retrieval Systems [{UP}course_dm13ms/Lecture13.pdf|(Download PDF)] </td><td></td> <td> Reading material:<br/> Chapter 14 of the text book (Principles of Data Mining)<br/> M. Mitra, B. Chaudhuri. [^http://www.springerlink.com/index/g465l6775267g380.pdf|Information retrieval from documents: A survey]. Information Retrieval 2000. M. Lew, N. Sebe, C. Djeraba, R. Jain. [^http://www.liacs.nl/~mlew/mir.survey16b.pdf|Content-based multimedia information retrieval: State of the art and challenges]. TOMCCAP 2006.<br/> D. Lowe. [^http://www.cs.ubc.ca/~lowe/papers/ijcv04.pdf|Distinctive Image Features from Scale-Invariant Keypoints]. IJCV 2004.<br/> Yoav Freund, R. Iyer, R.E. Schapire, Y. Singer. [^http://jmlr.org/papers/volume4/freund03a/freund03a.pdf|An Efficient Boosting Algorithm for Combining Preferences]. JMLR </td> </tr> <tr><td> </td></tr> <tr><td valign="top"> '''Dec. 17''': Guest Lecture by Nan Li </td><td></td> <td> </td> </tr> <tr><td> </td></tr> <tr><td valign="top"> '''Dec. 24''': Assignment Discussion & Data Mining V: In Computer Vision Systems [{UP}course_dm13ms/Lecture14.pdf|(Download PDF)] </td><td></td> <td> Reading material: <br/> P. Viola and M. Jones. [^http://research.microsoft.com/en-us/um/people/viola/Pubs/Detect/violaJones_IJCV.pdf|Robust Real-time Object Detection], IJCV 2001. </td> </tr> <tr><td> </td></tr> </table> ==Links== * [^http://www.cs.waikato.ac.nz/ml/weka/|Weka] An open source (Java) machine learning/data mining algorithms software. ** Note: in Weka 3.7, many algorithms are in the separated packages, [http://weka.sourceforge.net/packageMetaData/|http://weka.sourceforge.net/packageMetaData/], you will need to download them as well. * [^http://www.r-project.org/|R Project] An open source platform for statistic computing using R script language. ** [^http://cran.r-project.org/web/views/MachineLearning.html|Machine learning packages for R] * [^http://scikit-learn.org/stable/|Scikit-Learn] An open source machine learning packags for Python. * [^http://www.sigkdd.org/|ACM SIGKDD] The website of the ACM Special Interest Group on Knowledge Discovery and Data Mining. ** [^http://dl.acm.org/citation.cfm?id=J721&picked=prox&cfid=140024035&cftoken=61726307|ACM SIGKDD Explorations Newsletters] A magazine of SIGKDD. * [^http://www.kdnuggets.com/|KDnuggets] A website for data mining resources. ==Major academic venues== * Journals in data mining: [^http://www.informatik.uni-trier.de/~ley/db/journals/datamine/index.html|DMKD], [^http://www.informatik.uni-trier.de/~ley/db/journals/tkdd/index.html|TKDD], [^http://www.informatik.uni-trier.de/~ley/db/journals/tkde/index.html|TKDE], [^http://www.informatik.uni-trier.de/~ley/db/journals/kais/index.html|KAIS] * Journals in machine learning: [^http://www.informatik.uni-trier.de/~ley/db/journals/ml/index.html|MLJ], [^http://www.informatik.uni-trier.de/~ley/db/journals/jmlr/index.html|JMLR] * Journals in database: [^http://www.informatik.uni-trier.de/~ley/db/journals/tods/index.html|TODS], [^http://www.informatik.uni-trier.de/~ley/db/journals/vldb/index.html|VLDBJ] * Journals in information retrieval: [^http://www.informatik.uni-trier.de/~ley/db/journals/tois/index.html|TOIS], [^http://www.informatik.uni-trier.de/~ley/db/journals/ipm/index.html|IP&M], [^http://www.informatik.uni-trier.de/~ley/db/journals/ir/index.html|IRJ] * Journals in web search and mining: [^http://www.informatik.uni-trier.de/~ley/db/journals/www/index.html|WWWJ], [^http://www.informatik.uni-trier.de/~ley/db/journals/toit/index.html|TOIT], [^http://www.informatik.uni-trier.de/~ley/db/journals/tweb/index.html|TWeb] * Conferences in data mining: [^http://www.informatik.uni-trier.de/~ley/db/conf/kdd/index.html|KDD], [^http://www.informatik.uni-trier.de/~ley/db/conf/icdm/index.html|ICDM], [^http://www.informatik.uni-trier.de/~ley/db/conf/sdm/index.html|SDM], [^http://www.informatik.uni-trier.de/~ley/db/conf/ecml/index.html|ECML/PKDD], [^http://www.informatik.uni-trier.de/~ley/db/conf/pakdd/index.html|PAKDD] * Conferences in machine learning: [^http://www.informatik.uni-trier.de/~ley/db/conf/icml/index.html|ICML], NIPS, [^http://www.informatik.uni-trier.de/~ley/db/conf/colt/index.html|COLT] * Conferences in database: [^http://www.informatik.uni-trier.de/~ley/db/conf/sigmod/index.html|SIGMOD], [^http://www.informatik.uni-trier.de/~ley/db/journals/pvldb/index.html|VLDB], [^http://www.informatik.uni-trier.de/~ley/db/conf/icde/index.html|ICDE] * Conferences in information retrieval: [^http://www.informatik.uni-trier.de/~ley/db/conf/sigir/index.html|SIGIR], [^http://www.informatik.uni-trier.de/~ley/db/conf/cikm/index.html|CIKM] * Conferences in web search and mining: [^http://www.informatik.uni-trier.de/~ley/db/conf/www/index.html|WWW], [^http://www.informatik.uni-trier.de/~ley/db/conf/wsdm/index.html|WSDM]
The end