-
Notifications
You must be signed in to change notification settings - Fork 2
/
Copy pathResource_Management.Rpres
98 lines (78 loc) · 2.5 KB
/
Resource_Management.Rpres
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
Resource Management
========================================================
author: John Yocum
date: `r format(Sys.Date(), format="%B %d, %Y")`
transition: fade
Research Computing and Data Management
-------------------------------------------------------
[http://github.com/brianhigh/research-computing](http://github.com/brianhigh/research-computing)
<small style="font-size:.5em">
This work is licensed under a <a rel="license" href="http://creativecommons.org/licenses/by-sa/4.0/">Creative Commons Attribution-ShareAlike 4.0 International License</a>.<br />
<a rel="license" href="http://creativecommons.org/licenses/by-sa/4.0/"><img alt="Creative Commons License" style="border-width:0" src="https://i.creativecommons.org/l/by-sa/4.0/88x31.png" /></a>
</small>
Resource Management
========================================================
- Capacity Planning
- **System Resources**
* CPU
* RAM
* Disk
- Optimization
- Parallel Processing
- Monitoring Utilization
System Resources
========================================================
- **CPU:** Central Processing Unit
* Clock Speed
* Processor Cores
- **RAM:** Random Access Memory
* Insertable modules
* Relatively Cheap
* Fast
- **Disk**
* Sizes and types
* Network
* Arrays
Optimization
========================================================
- Monitor Utilization
* Windows
* Performance Monitor
* Mac
* Activity Monitor
* Linux
* htop
* iostat
- Find bottlenecks
- Reduce bottlenecks
***
<small style="font-size:.5em">
Source: [Used with permission from Microsoft](http://en.wikipedia.org/wiki/File:Performance_Monitor_-_Windows_7.png)
</small>
Memory Utilization
========================================================
Some applications read all data into RAM by default:
- R
- MATLAB
- Excel
- Stata
In each of these cases, there are some tools or methods to help reduce consumption.
CPU Utilization
========================================================
**Parallel Processing**
-------------------------------------------------------
- "Divide and Conquer"
- Break down tasks into many small ones
- Maximize CPU core utilization
- MapReduce
- Open source framework for parallel processing
- GNU Parallel
- Open source tool for managing parallel tasks
- Examples:
- Climate data
Summary
========================================================
- Capacity Planning
- Utilization Monitoring
- Bottlenecks