Homework 2: Difference between revisions

From Phobos Wiki
Jump to navigation Jump to search
No edit summary
No edit summary
 
(2 intermediate revisions by one other user not shown)
Line 48: Line 48:
== C++ ==
== C++ ==
=== Parse log file for invalid time stamps ===
=== Parse log file for invalid time stamps ===
Write a program that parses the provided example log file, [[Meedia:Ex_log.gz]] and checks for anomalies in time stamps (if the newer log line has an older time stamp). The normal behavior is that the time increases with each line downwards as shown below
Write a program that parses the provided example log file, [[Media:Ex_log.gz]] and checks for anomalies in time stamps (if the newer log line has an older time stamp). The normal behavior is that the time increases with each line downwards as shown below


<pre>
<pre>
Line 146: Line 146:
22
22
Invalid time stamps at line(s):
Invalid time stamps at line(s):
6
8-11
8-11
16-18
16-18
Line 190: Line 191:
</pre>
</pre>


If no arguments a given, output an error message: 'Input file missing'
If no arguments a given, output an error message: 'Input file missing'.
 
If no optional arguments are given, output is same as with stats argument.
If no optional arguments are given, output is same as with stats argument.


Line 201: Line 203:




[[Kasutaja:MarkTomm|MarkTomm]] 20. veebruar 2015, kell 14:18 (EET)
[[Kasutaja:MarkTomm|MarkTomm]] 15. juuli 2015, kell 16:10 (EEST)

Latest revision as of 10:52, 4 June 2019

Elementary knowledge of GIT, BASH, C++ will be tested.

Task may be completed on any Linux distribution (recommended debian/ubuntu)

GIT

  • Save work progress in a repository
  • Use branches (help)
    • One branch for implementing bash script and another branch for c++
    • commit often, total number of commits should be 10+
    • when checking out a random revision, it should compile.
    • Branches start from master and must be merged back into master

BASH

Script 1 - Show memory usage

Script has 1 optional argument, path to meminfo file (contains current memory status). If it's not provided use /proc/meminfo

Use standard unix tools like awk, grep, sed to parse the input file.

Example of input file 

cat /proc/meminfo 
MemTotal:        7969612 kB
MemFree:         4582768 kB
Buffers:          707368 kB
Cached:          1122984 kB
SwapCached:            0 kB
Active:          1742408 kB
Inactive:        1203472 kB
[ ... ]

output: 

./script1.sh /proc/meminfo
RAM: 4582 MB used / 7969 MB total ( 3387 MB free)

Script 2 - compile c++ application

Compiles the C++ application Probably only has 1 useful line, g++ with some linker options.

example: 

./script2.sh
Compilation started
Compilation finished

C++

Parse log file for invalid time stamps

Write a program that parses the provided example log file, Media:Ex_log.gz and checks for anomalies in time stamps (if the newer log line has an older time stamp). The normal behavior is that the time increases with each line downwards as shown below 

2015-02-19 17:33:08.584 [INFO] Gateway.port9.db -  (122) event: 2 flags: GwTime GI  time: 2015-Feb-19 17:33:08.583703, received
2015-02-19 17:33:08.585 [INFO] Gateway.port6.db -  (41) event: 2 flags: GwTime GI  time: 2015-Feb-19 17:33:08.585024, received
2015-02-19 17:33:08.586 [INFO] Gateway.port6.db -  (42) event: 2 flags: GwTime GI  time: 2015-Feb-19 17:33:08.585943, received
2015-02-19 17:33:08.598 [INFO] Gateway.Port15.db -  (40) event: 1 flags: GwTime GI  time: 2015-Feb-19 17:33:08.551947, sent
2015-02-19 17:33:08.599 [INFO] Gateway.Port15.db -  (120) event: 2 flags: GwTime GI  time: 2015-Feb-19 17:33:08.528113, sent
2015-02-19 17:33:08.604 [INFO] Gateway.port9.db -  (123) event: 1 flags: GwTime GI  time: 2015-Feb-19 17:33:08.603814, received
2015-02-19 17:33:08.606 [INFO] Gateway.port6.db -  (43) event: 2 flags: GwTime GI  time: 2015-Feb-19 17:33:08.586459, received
2015-02-19 17:33:08.607 [INFO] Gateway.port6.db -  (44) event: 2 flags: GwTime GI  time: 2015-Feb-19 17:33:08.606645, received
2015-02-19 17:33:08.607 [INFO] Gateway.port6.db -  (45) event: 2 flags: GwTime GI  time: 2015-Feb-19 17:33:08.607344, received

An erroneous log would look like the next short example 

2015-02-19 17:33:08.790 [INFO] Gateway.port10.db -  (128) event: 1 time: 2015-Feb-19 17:31:58.520000, received
2015-02-19 17:33:08.792 [INFO] Gateway.WebServer.db -  (128) event: 1 time: 2015-Feb-19 17:31:58.520000, sent
2015-02-19 11:23:08.808 [INFO] Gateway.Port15.db -  (128) event: 1 time: 2015-Feb-19 17:31:58.520000, sent
2015-02-19 11:23:08.812 [INFO] Gateway.port10.db -  (129) event: 1 time: 2015-Feb-19 17:31:58.855000, received
2015-02-19 11:23:08.814 [INFO] Gateway.WebServer.db -  (129) event: 1 time: 2015-Feb-19 17:31:58.855000, sent
2015-02-19 11:23:08.815 [INFO] Gateway.port10.db -  (130) event: 1 time: 2015-Feb-19 17:31:58.176000, received
2015-02-19 11:23:08.817 [INFO] Gateway.WebServer.db -  (130) event: 1 time: 2015-Feb-19 17:31:58.176000, sent
2015-02-19 17:33:08.817 [INFO] Gateway.port10.db -  (131) event: 1 time: 2015-Feb-19 17:31:58.091000, received
2015-02-19 17:33:08.837 [INFO] Gateway.Port15.db -  (129) event: 1 time: 2015-Feb-19 17:31:58.855000, sent

Note that year-month-day could also be 'wrong'. 

2015-02-19 17:33:08.895 [INFO] Gateway.port7.db -  (54) event: -0.058075 flags: GwTime GI Normalized  time: 2015-Feb-19 17:33:08.895493, received
2015-02-19 17:33:08.897 [INFO] Gateway.port8.db -  (81) event: 0.771538 flags: GwTime GI Normalized  time: 2015-Feb-19 17:33:08.896834, received
2015-02-19 17:33:08.898 [INFO] Gateway.port8.db -  (82) event: 0.541642 flags: GwTime GI Normalized  time: 2015-Feb-19 17:33:08.897743, received
2012-01-15 17:33:08.898 [INFO] Gateway.port8.db -  (83) event: -0.523254 flags: GwTime GI Normalized  time: 2015-Feb-19 17:33:08.898286, received
2012-01-15 17:33:08.899 [INFO] Gateway.port8.db -  (84) event: -0.142151 flags: GwTime GI Normalized  time: 2015-Feb-19 17:33:08.898931, received
2012-01-15 17:33:08.899 [INFO] Gateway.port8.db -  (85) event: 0.0126041 flags: GwTime GI Normalized  time: 2015-Feb-19 17:33:08.899393, received
2015-02-19 17:33:08.900 [INFO] Gateway.port8.db -  (86) event: 0.0643635 flags: GwTime GI Normalized  time: 2015-Feb-19 17:33:08.899999, received
2015-02-19 17:33:08.900 [INFO] Gateway.port8.db -  (87) event: -0.507019 flags: GwTime GI Normalized  time: 2015-Feb-19 17:33:08.900444, received

Or both...


Program accepts one out of three optional arguments: stats, list or all. Examples 

./a.out filename --stats
./a.out filename
./a.out filename --all

--stats
    Outputs statistical information about time stamp anomalies.

--list
    Outputs lines with erroneous time stamps along with line numbers.

--all
    Outputs lines with erroneous time stamps along with line numbers 
    and statistical information about time stamp anomalies

Examples

A short example log file 

2015-02-19 13:28:33.778 [INFO] Gateway.Port15.db -  (35) event: 2 time: 2015-Feb-19 17:32:02.013000, sent
2015-02-19 13:28:33.778 [INFO] Gateway.Port15.db -  (133) event: 2 time: 2015-Feb-19 17:31:52.336000, sent
2015-02-19 13:28:33.788 [INFO] Gateway.WebServer.db -  (36) event: 1 time: 2015-Feb-19 17:32:01.386000, sent
2015-02-19 13:28:33.791 [INFO] Gateway.WebServer.db -  (134) event: 2 time: 2015-Feb-19 17:31:52.030000, sent
2015-02-19 13:28:33.797 [INFO] Gateway.port10.db -  (135) event: 2 time: 2015-Feb-19 17:31:52.035000, received
2015-02-19 13:28:33.795 [INFO] Gateway.port6.db -  (37) event: 2 time: 2015-Feb-19 17:32:01.157000, received
2015-02-19 13:28:33.804 [INFO] Gateway.WebServer.db -  (135) event: 2 time: 2015-Feb-19 17:31:52.035000, sent
2015-02-19 11:28:33.805 [INFO] Gateway.port10.db -  (136) event: 1 time: 2015-Feb-19 17:31:52.090000, received
2015-02-19 11:28:33.806 [INFO] Gateway.WebServer.db -  (37) event: 2 time: 2015-Feb-19 17:32:01.157000, sent
2015-02-19 11:28:33.807 [INFO] Gateway.Port15.db -  (36) event: 1 time: 2015-Feb-19 17:32:01.386000, sent
2015-02-19 11:28:33.807 [INFO] Gateway.Port15.db -  (134) event: 2 time: 2015-Feb-19 17:31:52.030000, sent
2015-02-19 13:28:33.808 [INFO] Gateway.Port15.db -  (135) event: 2 time: 2015-Feb-19 17:31:52.035000, sent
2015-02-19 13:28:33.810 [INFO] Gateway.port6.db -  (38) event: 2 time: 2015-Feb-19 17:32:01.744000, received
2015-02-19 13:28:33.813 [INFO] Gateway.WebServer.db -  (38) event: 2 time: 2015-Feb-19 17:32:01.744000, sent
2015-02-19 13:28:33.814 [INFO] Gateway.WebServer.db -  (136) event: 1 time: 2015-Feb-19 17:31:52.090000, sent
2015-01-19 13:18:33.819 [INFO] Gateway.Port15.db -  (37) event: 2 time: 2015-Feb-19 17:32:01.157000, sent
2015-01-19 13:18:33.819 [INFO] Gateway.Port15.db -  (38) event: 2 time: 2015-Feb-19 17:32:01.744000, sent
2015-01-19 13:18:33.820 [INFO] Gateway.Port15.db -  (136) event: 1 time: 2015-Feb-19 17:31:52.090000, sent
2015-02-19 13:28:33.821 [INFO] Gateway.port10.db -  (137) event: 2 time: 2015-Feb-19 17:31:52.637000, received
2015-02-19 13:28:33.823 [INFO] Gateway.WebServer.db -  (137) event: 2 time: 2015-Feb-19 17:31:52.637000, sent
2015-02-19 13:28:33.824 [INFO] Gateway.port6.db -  (39) event: 2 time: 2015-Feb-19 17:32:02.451000, received
2015-02-19 13:28:33.826 [INFO] Gateway.WebServer.db -  (39) event: 2 time: 2015-Feb-19 17:32:02.451000, sent

$ ./a.out example_log --stats
Number of lines:
22
Invalid time stamps at line(s):
6
8-11
16-18

$ ./a.out example_log --list
Lines with invalid time stamps:
[7] 2015-02-19 13:28:33.804 [INFO] Gateway.WebServer.db -  (135) event: 2 time: 2015-Feb-19 17:31:52.035000, sent
[8] 2015-02-19 11:28:33.805 [INFO] Gateway.port10.db -  (136) event: 1 time: 2015-Feb-19 17:31:52.090000, received
[9] 2015-02-19 11:28:33.806 [INFO] Gateway.WebServer.db -  (37) event: 2 time: 2015-Feb-19 17:32:01.157000, sent
[10] 2015-02-19 11:28:33.807 [INFO] Gateway.Port15.db -  (36) event: 1 time: 2015-Feb-19 17:32:01.386000, sent
[11] 2015-02-19 11:28:33.807 [INFO] Gateway.Port15.db -  (134) event: 2 time: 2015-Feb-19 17:31:52.030000, sent
[12] 2015-02-19 13:28:33.808 [INFO] Gateway.Port15.db -  (135) event: 2 time: 2015-Feb-19 17:31:52.035000, sent
---
[15] 2015-02-19 13:28:33.814 [INFO] Gateway.WebServer.db -  (136) event: 1 time: 2015-Feb-19 17:31:52.090000, sent
[16] 2015-01-19 13:18:33.819 [INFO] Gateway.Port15.db -  (37) event: 2 time: 2015-Feb-19 17:32:01.157000, sent
[17] 2015-01-19 13:18:33.819 [INFO] Gateway.Port15.db -  (38) event: 2 time: 2015-Feb-19 17:32:01.744000, sent
[18] 2015-01-19 13:18:33.820 [INFO] Gateway.Port15.db -  (136) event: 1 time: 2015-Feb-19 17:31:52.090000, sent
[19] 2015-02-19 13:28:33.821 [INFO] Gateway.port10.db -  (137) event: 2 time: 2015-Feb-19 17:31:52.637000, received

$ ./a.out example_log --all
Number of lines:
22
Invalid time stamps at line(s):
8-11
16-18

Lines with invalid time stamps:
[7] 2015-02-19 13:28:33.804 [INFO] Gateway.WebServer.db -  (135) event: 2 time: 2015-Feb-19 17:31:52.035000, sent
[8] 2015-02-19 11:28:33.805 [INFO] Gateway.port10.db -  (136) event: 1 time: 2015-Feb-19 17:31:52.090000, received
[9] 2015-02-19 11:28:33.806 [INFO] Gateway.WebServer.db -  (37) event: 2 time: 2015-Feb-19 17:32:01.157000, sent
[10] 2015-02-19 11:28:33.807 [INFO] Gateway.Port15.db -  (36) event: 1 time: 2015-Feb-19 17:32:01.386000, sent
[11] 2015-02-19 11:28:33.807 [INFO] Gateway.Port15.db -  (134) event: 2 time: 2015-Feb-19 17:31:52.030000, sent
[12] 2015-02-19 13:28:33.808 [INFO] Gateway.Port15.db -  (135) event: 2 time: 2015-Feb-19 17:31:52.035000, sent
---
[15] 2015-02-19 13:28:33.814 [INFO] Gateway.WebServer.db -  (136) event: 1 time: 2015-Feb-19 17:31:52.090000, sent
[16] 2015-01-19 13:18:33.819 [INFO] Gateway.Port15.db -  (37) event: 2 time: 2015-Feb-19 17:32:01.157000, sent
[17] 2015-01-19 13:18:33.819 [INFO] Gateway.Port15.db -  (38) event: 2 time: 2015-Feb-19 17:32:01.744000, sent
[18] 2015-01-19 13:18:33.820 [INFO] Gateway.Port15.db -  (136) event: 1 time: 2015-Feb-19 17:31:52.090000, sent
[19] 2015-02-19 13:28:33.821 [INFO] Gateway.port10.db -  (137) event: 2 time: 2015-Feb-19 17:31:52.637000, received

If no arguments a given, output an error message: 'Input file missing'.

If no optional arguments are given, output is same as with stats argument.

Note that with list argument one line before and after the invalid time stamp is also output (look closer at the example outputs).

Program is output to 'standard output'.

Use boost libraries: format, date_time, filesystem.


MarkTomm 15. juuli 2015, kell 16:10 (EEST)

Retrieved from "https://phobos.martem.ee/w/index.php?title=Homework_2&oldid=2215"