regex - Manipulating huge CSV files with sed -

-

I have a set of 4 large CSV files, which I need to modify. What I need to do is this expression Match (. *), Copy the atom to / , then include it later on each line until the atom is reconciled. Then I need to rinse and repeat till the end of the file (there are approximately 25k lines in each file). After all I need to go back and forth through the atom for the first time.

If this is possible, I would like to use sed for it. I tried to do it with VIM but regex could not get it right. Any help would be greatly appreciated. An example is illustrated below:

Earlier:

0917 ,,, 882-1273,1, 95F 9475,1, 276 -080, 1, 40, 0080,1, 275-690 A, 1, TX-2311,3, TX-3351,4, B-07432,1, B-6901,1, 23-753,1, 02F 4307,1,1 QBK-ND, 1, 0944-026,1, 0944-027,1, 0944-004,1, 0944-056,1, 0944-057,1, 0944-082,1, 0944- 024,1, 0944 -05,1, 0944-102,4, Lor 102,1 0918, CJ1085,1, 1352-152,4, DMS3102 A-18-, 1, 6-32 KEP, 7, 6-32 X 3/4, 4, 6-32 X1 / 2,4, 1251-102,8, Oct-32, 4, 10-32, SAE, 8

After: 

  0917,882-1273,1 0917.95 F 9475,1 0917,276-080,1 0917,40 of 0080,1 0917,275-690 A, 1917, TX-2311,3 0917, TX-3351,4 0917, B-07432,1 9 17, B-6901,1 9, 23-753,1 0902 F 4307,1 9 09, 5.1 .1 QBK-ND, 1917,0 9 44-026,1 0917, 0944-027,1 0917,0 9 44-004,1 0917,0 9 44-056,1 0917,0 9 44-057, 1 0917,0 9 44-082,1 0917,0 9 44-024,1 0917,0 9 44-025,1 0917, 0944-102,4 9 17, Lor 102,1 0918, CJ1085,1 9, 18,1352-152,4 9 18, DMS3102 A-18-, 19618-32, KEP, 779 932 x 3 / 4,4 0918,6-32X1 / 2,4 918,1251- 102,8 0918, October-324 918,10-32, SAE 8,

< P> program (python) 

  import csv infile = file ("in", "r") outfile = file ("out", "w") reader = csv.reader (infile, Dialect = 'excel') writer = csv Author (outfile, dialect = 'excel') current_header = "" In the reader for the input: if lane (inro [0] .stip ())! = 0: current_header = inrow [0] Continue the author. The author (author [current_header] + INRO [1:]) infile.close () outfile.close () print "done"

input 

  0917 ,,, 882-1273, 1, 95 F 9475,1, 276-080,1, 40 of 0080,1, 275-690 A, 1, TX-2311,3, TX-3351,4, B74741 , B-6901,1, 23 -753,1, 02F4307,1, 5.1 QBK-ND, 1, 0944-026,1, 0944-027,1, 0944-004,1, 0944-056,1 , 0944-057,1, 0944- 081, 0944-024,1, 0944-025,1, 0944-102,4, Lor 102,1 0918, CJ1085,1, 1352-152,4, DMS 3102 a-18-, 1, 6-32 keip, 7, 6-32 x 3 / 4,4, 6-32 x 1 / 2,4, 1251-102,8, Oct-32, 4, 10-32 SAE, 8

Output 

  0917,882-1273,1 0917.95 F 9475,1 0917,276-080,1 0917,40 K 0080,1 0917,275-690 A, 1917, TX-2311, 9 17, TX-3351,4 0917, B74741, 0917, B-6901,1 0917, 23-753,1 0917,02 F4307,1 0917,5.1 QBK-ND, 1 0917,0 9 44-026,1 0917,0 9 44-027,1 0917,0 9 44 -004,1 0917,0 9 44-056,1 9 17, 0944-057,1 0917,0 9 44-082,1 0917,0 9 44-024,1 0917,0 9 44-025,1 0917,0 9 44-102, 4 0917, Lor 102,1 0918, CJ1085,1 9, 181352-152, 4 0918, DMS3102A-18-, 1918,6-32, KEP, 7791818-32X3 / 4,4 9 8 9 -32-X-2 / 2,4 9, 18, 1251-102,8, 0918, October -32, 4 0918, 10-32, SAE, 8

Have fun


Comments

Post a Comment

Popular posts from this blog

c# - ListView onScroll event -

-
I am programming a simple C # application, and I need a Scallow event on the list view. So I inherited the original ListView class created in ListviewEx witch. I found out how to locate the scroll message from WinAPI and I modified the WndProc method. Now I have this WndProc: protected override zero WndProc (Ref message message) {base.WndProc (Ref I); If (m.msg == WM_VSCROLL) {onScroll (This, New EventArgs ()); }} But the problem is, I do not know how to know about scrolling information. This data should be in wParam, but there is a LOWORD macro ++ like in C in C # and I switch to find the criteria like SB_ below, SB_ENDSCROLL, SB_PAGEUP etc. there any way Need to change the LOWORD macro from C #? Or any other way to find the necessary parameters about scrolling? You can define the WParam constants as the following: Private const int WM_HSCROLL = 0x114; Private Constant WM_VSCROLL = 0x115; Private contact int SBHOZZ = 0; Private Consultant SB_VERT = 1; Private Con...
Read more

PHP - get image from byte array -

-
I am trying to create a back-end for my mobile application. I am sending the content of an image in the body of the HTTP request (output stream) as a byte array, I want to read this stream of bytes in PHP scripts and take back an image. Can anyone tell me how can I do this? Thank you. You can obtain the request body $ body = Reading from file_get_contents ('php: // input'); What you do with that data Depending on you, you can write the data in a file as you mentioned that this is image data, you can drop the data into the object can do. Another option is to use and load the image.
Read more

Linux Terminal Problem with Non-Canonical Terminal I/O app -

-
I have a small app written in C to run on Linux. Part of the app accepts user-input from keyboard , And it uses non-canonical terminal mode so that it can respond to each keystroke. The section of the code that accepts input is a simple task that is called repeatedly in the loop: char get_input () {char C = 0; Int res = reading (input_tamille, & amp; c, 1); If (RSS == 0) 0 returns; If (res == -1) {/ * snip error handling * /} return c; } It reads a letter from the terminal if there is no input within a given time limit, (c_cc [VTIME] value in the vocabulary structure), read () 0 And get_input () is called again It all works very well, I have recently discovered that if you run this app in a terminal window, and then the app Close the terminal window without ending, the app will not exit Received, but CPU intensive launches into an infinite loop, where the read () returns 0 without waiting continued. So how can I get out of the apple if it runs from the terminal win...
Read more