사회통계포럼

Size: px

Start display at page:

Download "사회통계포럼"

태경 저
5 years ago
Views:

2 Acknowledgements Dr. Roger Peng Coursera course. Creative Commons by Attribution /.

3 10 : SNS (twitter, facebook), (functional data) : (, ),, /Data Science ( )

4 - (Machine Learning), ( ) ( ), ( )

5 : - University of Washington Center for Statistics and Social Sciences curriculum : Statistical Machine Learning :

6 6 : - 9 : - 10 : - 11 : - 12 : Workshop

7 University of Washington Center for Statistics and Social Sciences! The Center for Statistics and the Social Sciences (CSSS) promotes collaborative interdisciplinary research on statistical methods for the social sciences, and teaches a rich menu of courses for social science students 5 core faculty member (Faculty Affiliates) (Statistical consulting for the social sciences) Math Camp - Lectures/ Seed Grant Weekly seminar

8 CSSS courses Structural Equation Models Survey Research Methods Sample Survey Techniques Analysis of Categorical and Count Data Event History Analysis Hierarchical Modeling for the Social Sciences Bayesian Statistics for the Social Sciences Causal Modeling Statistical Analysis of Social Network Visualizing Data

9 ( )! Bayesian Statistics Graphical Model (Structural Equation Model) Item Response Theory Multilevel/Hierarchical Modeling Social Network Analysis

11 new trend Computing - R Data Visualization LASSO Independent Component Analysis (Reproducible Research) Topic model in Textmining Exponential Random Graph model in Social Network Analysis

12 R Commander/R Studio (Excel/ SAS ) 4 ( ) (..) / code code sharing -

13 R? Data Analysts Captivated by R s Power (NYTimes 1/6/2009)

14 trend :

15 R? R. - :,,,,

16 R Screenshot :

17 R Commander R commander McMaster John Fox R R GUI (Graphical User Interface). R commander R console install. >install.package( Rcmdr ) >library(rcmdr)

R commander Screenshot : http://socserv.

18 R commander Screenshot :

19 R Commander Drop down menu Toolbar Script window: type output windows : output : Message windows :error message :warnings :

20 RStudio R (Integrated Development Environment) R beta.rstudio.org gmail account. download

21 R Studio Screenshot :

Growth in a Time of Debt : http://www.businessweek.

22 Growth in a Time of Debt : economists-spreadsheet-error-upends-the-debt-debate

23 Excel error that changed History 2010 Reinhart Rogoff government debt gross domestic product 90% Growth in a Time of Debt ( 90% threshold ) UMass Reinhart Rogoff % 2.2%.

24 Reproducible Research (, ) code

26 Repeatability of published microarray gene expression analyses Nature genetics microarray / 2

27 : 2 : 6 : 10

28 2011 Science Data Replication& Reproducibility special issue Reproducible Research in Computational Science, R.D. Peng, Improving Validation Research in Omics Research, J.P.A. Ioannidis and M.J. Khoury

29 (SAS, SPSS) format (analysis1.r, analysis2.r, final.r, Real-final.R) ( ) supplemental materials

30 The Art of Programing :

31 Markdown Git R package Knitr

32 Statistical (Machine) Learning Prediction, Prediction, Prediction!!!! (Penalized Regression): Lasso, Ridge Text Mining: Sentiment Analysis, Topic Model Supervised Learning: Support Vector Machine, Neural Network, Tree Method, Logistic Regression Unsupervised Learning: Principle Component Analysis, Independent Component Analysis, K-means++ Other Learning: Semi-supervised Learning, Online Learning, Deep Learning, Active Learning

Introduction to Statistical Learning : http:// online.stanford.

33 Introduction to Statistical Learning : online.stanford.edu/course/statisticallearning-winter-2014 Download PDF at

34 Privacy in Big data! Netflix (1st) Competition Recommend system open competition 48 17, training set test set Netflix 2nd competition cancellation (IMDb vs Netflix)

35 Privacy Privacy-Preserving Data Mining Statistical Disclosure Limitation Data Masking/Jittering Bias Variance

36 UN Global Pulse

37 Sending the Police Before There s Crime (NYTimes, 8/15/2011)

38 Global Pulse UN global development SNS Job loss prediction disease outbreak prediction

39 - Selection bias -?

40 ? (multiple comparison) A %.? (John Tukey, 1976)

41 ? -, (, 2013/3/ 6) - selection bias :

42 ,, (, ), ( ).

김기남_ATDC2016_160620_[키노트].key

김기남_ATDC2016_160620_[키노트].key metatron Enterprise Big Data SKT Metatron/Big Data Big Data Big Data... metatron Ready to Enterprise Big Data Big Data Big Data Big Data?? Data Raw. CRM SCM MES TCO Data & Store & Processing Computational