Statistická analýza dat

Prezentace na téma: "Statistická analýza dat"— Transkript prezentace:

1 Statistická analýza dat
Daniel Svozil Laboratoř informatiky a chemie, FCHT Vojtěch Spiwok, ÚBM, FPBT

2 Informace přednášky – základy, opáčko, cvičení – R
Další literatura D. J. Rumsey, Statistics for Dummies, 2011 D. J. Rumsey, Intermediate Statistics for Dummies, 2007 zápočet, zkouška – bude oznámeno

3 Valuing houses SIZE [ft2] COST [$] 1 400 112 000 2 400 192 000 1 800
1 900 1 300 1 100 88 000 How much money should you expect to pay for ft2 house? $ Same question now with ft2 ? $

4 Valuing houses SIZE [ft2] COST [$] 1 400 112 000 2 400 192 000 1 800
1 900 1 300 1 100 88 000 How much money should you expect to pay for ft2 house? $ 21 is just a half between 18 and 24.

5 What a statistician does?
Look at data Program computers Run statistics software Drink beer

6 Linear relationship SIZE [ft2] COST [$] 1 400 98 000 2 400 168 000
1 800 1 900 91 000 1 100 77 000 Is there a fixed amount per square foot? No What if I change to 1 300? What is the answer now? Yes

7 Scatter plots (bodový graf)
Please, take a pen and a paper and draw a scatter plot of these data. SIZE [ft2] COST [$] 1 400 98 000 2 400 1 800 1 900 1 300 91 000 1 100 77 000 PRICE SIZE

8 Scatter plots SIZE [ft2] COST [$] 1 700 53 000 2 100 65 000 1 900
59 000 1 300 41 000 1 600 50 000 2 200 68 000 Is there a fixed price per square foot? No

9 Scatter plots SIZE [ft2] COST [$] $/ft2 1 700 53 000 31.1765 2 100
65 000 1 900 59 000 1 300 41 000 1 600 50 000 2 200 68 000 What do you think, is the data linear? Let’s make a scatter plot. Surprisingly, the data is linear, even if there is no fixed price per square foot! PRICE = AA x SIZE + BB PRICE = 30 x SIZE

10 Scatter plots SIZE [ft2] COST [$] 1 700 53 000 2 100 44 000 1 900
59 000 1 300 82 000 1 600 50 000 2 200 68 000 Draw scatterplot and tell me if these data are linear (i.e., do they lie in a line?). outliers

11 Bar chart SIZE [ft2] COST [$] 1 300 88 000 1 400 72 000 1 600 94 000
1 900 86 000 2 100 2 300 98 000 Warm up. Are these data linear? No How much to pay for a ft2 house? Just simply interpolate. Do you have trust in this number?

12 Bar chart Take your data and pull them together.

13 Bar chart SIZE [ft2] COST [$] 1 300 88 000 1 400 72 000 1 600 94 000
1 900 86 000 2 100 2 300 98 000

14 Bar chart Much finer representation of the data
Bar chart allows you to understand global trends Statistician uses cumulative tools (such as bar graph) to gain the understanding of the underlying data.

15 Histograms Special case of bar chart.
Bar chart looks at 2D data, histogram to 1D data. That is the main difference.

16 Age distribution Draw a histogram at the paper with the bins by 10 years (i.e. 0-10, 11-20, …) 29 27 14 21 12 9 17 14 32 3 39 9 4 33 38 21 31 29 8 15

17 Věková pyramida věková pyramida (strom života) grafické znázornění věkové struktury obyvatelstva source:

18 Histogram Now I will collect heights of all of you in this room.
Use Interactive Histogram Applet: interval, bin

19 Histogram – Body fat In Interactive Histogram Applet – choose „Body fat % in 252 men“ dataset. Find reasonable bin size Answer following questions. No matter of bin size what is always true? Most scores fall around 20%. The shape is roughly symmetrical. Most scores fall in the middle of distribution. There are more scores between 15 and 25 than between 35 and 50. There are more scores between 0 and 10 than between 18 and 24. Relatively more men have a body fat above 35% or below 5%.

20 Histogram – Income distribution
United States Census Bureau – Income Number of houses 10 000 9401 20 000 14447 30 000 13642 40 000 12388 50 000 11028

21 Histogram – Income distribution
This is an example of a (positively) skewed distribution (zprava zešikmené rozdělení). This distribution is not symmetrical. Most incomes fall to the left of the distribution.

22 Pie charts koláčový graf elections Party A – 50% Party B – 50%
Party A – votes Party B – votes

23 Ktery odpovida temto datum? - E
B C D E

24 Pie charts Party A – 175 000 Party B – 50 000 Party C – 25 000
Party D – Please, draw the pie chart udacity – Introduction to statistics – 5. Pie charts – Build a chart 4/12, 2/12, 1/12, 2/12 v poslednim prikladu pro Party A B C D A: 4/12 B: 2/12 C: 1/12 D: 2/12

25 Bar chart and scatter plot
Which scatter plot corresponds to this bar chart? udacity – Introduction to statistics – Problem set 1: Visualization – Bar chart to Scatterplot – min: na konci videa Obrazek je na nasledujicim slidu.

26 Pie chart to histogram Which histogram looks like it cames from the same data? udacity – Introduction to statistics – Problem set 1: Visualization – Pie chart to Histogram – min: na konci videa Oba tyto grafy znazornuji frekvence. Obrazek je na nasledujicim slidu.