regex - Python Unicode Regular Expression -

-

I am using Python 2.4 and I am facing some problems with Unicode regular expressions. Have tried to collect a very clear and concise example. It seems as if there is some problem with Python different character encoding, or I understand a problem in my understanding. Thank you very much for taking a look! This is a simple dragon program, which displays my problems with Python in regular expression and character encoding. # Brian J. Thank you for the # thank you written by Steiner.

Help! Import urllib # off Internet import chardet # files from the charactor encoding again to get #import ponyguruma # dragon Onyguruma regular expression # Python regular expressions to import identity - this is uncommented be if you feel like messing with it , But I am not the only issue which I am using rawdata = urlib.urlopen ('http://www.cs.unm.edu/~brian.stinar/legal.html') of RE .read ( ) Print (chardet.detect (rawdata)) # print (rawdata) as ISO_8859_2_encoded = rawdata.decode ('ISO-8859-2') # UTF_8_encoded = ISO_8859_2_encoded.encode seems to grab the ( 'utf-8') # and as UTF-8's print text encode (chardet.detect (UTF_8_encoded)) # # good it does not work perfectly, even though you can see the end HTML # uNSUBSCRIBE in, I want to fully understand the physical address and unsubscribe it re_UNSUB_amsterdam = re.compile in the above ( ". * uNSUBSCRIBE. *", re.UNICODE) Print (STR (Re_UNSUB_amsterdam.match (UTF_8_encoded)) "\ t \ t \ t \ t \ t ---" RE "print for UNSUBSCRIBE at UTF-8 (STR (re_UNSUB_am Ste Rdam.match (rawdata)) + "for raw UNSUBSCRIBE data" \ t \ t \ t \ t \ t --- RE) re_amsterdam = re.compile (". *. *. * ", Re.UNICODE) print (Str (re_amsterdam.match (rawdata)) +" \ t --- 'Adobe' on raw data for RE) # However, this work?!? Print (str (re_amsterdam.match (UTF_8_encoded)) for "Adobe" on UTF-8 "\ t --- RE") '' '#include addon, I used this regular expression library for a very unsatisfactory result try new_re = ponyguruma.Regexp ( ". * UNSUBSCRIBE *.") If new_re.match (UTF_8_encoded) = none: print ( "Ponyguruma RE did not match \ t \ t \ t --- on UTF-8 RE for the UNSUBSCRIBE! ") And: print (" No match for UNSUBSCRIBE on Poniguruma RE-UTF-8 \ t \ t --- RE was not eaten ") if new_line (raw data)! = None: Q ("Ponyguruma RE \ t \ t --- Unsubscribe on raw data") Newtest ("PaniGuruma RE \ t \ t --- unsubscribe on raw data".) And: print ("Panini ray Milan! \ T \ t \ t--- RA for UNSUBSCRIBE on raw data") and: new_re = ponyguruma.Regexp (RE * Adobe to "*") If not new_re not match Kmel (UTF_8_encoded)! = none: print was matched ( "Ponyguruma RE! \ T \ t \ t --- UTF- 8 for Adobe ") Other: Print (" Phenigurama RE did not match \ t \ t \ t --- "RE for Adobe on UTF-8") new_re = ponyguruma.Regexp (". *. *. * ") If new_re.match (rawdata)! = None: print (" Panini ray matching! \ T \ t \ t --- RA for Adobe on raw data ") and: print (" Ponyguruma does not match RE I'm working on a replacement project, and there is a hard time running non-ASCII. This problem with encoded files is part of a larger project - in the end I want to substitute the text with other text once again (thanks. I have been working in this ASCII, but I found I can not yet identify events in other encodings).

- Brian J. Steiner -

You probably want to either enable the DotALL flag or match instead of the search The method you want to use is: 

  # DOTALL creates matches Newline re_UNSUB_amsterdam = re.compile (". * UNSUBSCRIBE.", "UNUNODE | RE.DOTALL"

Or: 

  Find # of search matches, even if they are strings Do not be at the beginning of c ... re_UNSUB_amsterdam.search (foo) ...

These will give you different results, but both of you should give the match. (See how you want it to be one.)

On one side: You are receiving encoded text (which bytes) and decode text (characters) are confusing. It is not uncommon, especially in the former 3.x Python. Specifically, it is very suspicious: 

  ISO_8859_2_encoded = rawdata.decode ('ISO-8859-2')

You are < Strong> D - Coding with ISO-8859-2, no-coding N , so call this variable "decode". (Why not "ISO_8859_2_decoded"? Because ISO_8859_2 is an encoding. A decoded string encoding is not anymore.) To

Try to do match the rest of your code on rawdata and UTF_8_encoded (both Encoded strings) when it should probably be used rather than decoded Unicode string.


Comments

Post a Comment

Popular posts from this blog

c# - ListView onScroll event -

-
I am programming a simple C # application, and I need a Scallow event on the list view. So I inherited the original ListView class created in ListviewEx witch. I found out how to locate the scroll message from WinAPI and I modified the WndProc method. Now I have this WndProc: protected override zero WndProc (Ref message message) {base.WndProc (Ref I); If (m.msg == WM_VSCROLL) {onScroll (This, New EventArgs ()); }} But the problem is, I do not know how to know about scrolling information. This data should be in wParam, but there is a LOWORD macro ++ like in C in C # and I switch to find the criteria like SB_ below, SB_ENDSCROLL, SB_PAGEUP etc. there any way Need to change the LOWORD macro from C #? Or any other way to find the necessary parameters about scrolling? You can define the WParam constants as the following: Private const int WM_HSCROLL = 0x114; Private Constant WM_VSCROLL = 0x115; Private contact int SBHOZZ = 0; Private Consultant SB_VERT = 1; Private Con...
Read more

PHP - get image from byte array -

-
I am trying to create a back-end for my mobile application. I am sending the content of an image in the body of the HTTP request (output stream) as a byte array, I want to read this stream of bytes in PHP scripts and take back an image. Can anyone tell me how can I do this? Thank you. You can obtain the request body $ body = Reading from file_get_contents ('php: // input'); What you do with that data Depending on you, you can write the data in a file as you mentioned that this is image data, you can drop the data into the object can do. Another option is to use and load the image.
Read more

Linux Terminal Problem with Non-Canonical Terminal I/O app -

-
I have a small app written in C to run on Linux. Part of the app accepts user-input from keyboard , And it uses non-canonical terminal mode so that it can respond to each keystroke. The section of the code that accepts input is a simple task that is called repeatedly in the loop: char get_input () {char C = 0; Int res = reading (input_tamille, & amp; c, 1); If (RSS == 0) 0 returns; If (res == -1) {/ * snip error handling * /} return c; } It reads a letter from the terminal if there is no input within a given time limit, (c_cc [VTIME] value in the vocabulary structure), read () 0 And get_input () is called again It all works very well, I have recently discovered that if you run this app in a terminal window, and then the app Close the terminal window without ending, the app will not exit Received, but CPU intensive launches into an infinite loop, where the read () returns 0 without waiting continued. So how can I get out of the apple if it runs from the terminal win...
Read more