ascii – IT Nursery

Convert Unicode to ASCII without errors in Python

June 2, 2022 by IT Nursery

My code just scrapes a web page, then converts it to Unicode. html = urllib.urlopen(link).read() html.encode(“utf8″,”ignore”) self.response.out.write(html) But I get a UnicodeDecodeError: Traceback (most recent call last): File “/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/webapp/__init__.py”, line 507, in __call__ handler.get(*groups) File “/Users/greg/clounce/main.py”, line 55, in get html.encode(“utf8″,”ignore”) UnicodeDecodeError: ‘ascii’ codec can’t decode byte 0xa0 in position 2818: ordinal not in range(128) … Read more

(grep) Regex to match non-ASCII characters?

June 1, 2022 by IT Nursery

On Linux, I have a directory with lots of files. Some of them have non-ASCII characters, but they are all valid UTF-8. One program has a bug that prevents it working with non-ASCII filenames, and I have to find out how many are affected. I was going to do this with find and then do … Read more

Convert character to ASCII numeric value in java

May 28, 2022 by IT Nursery

I have String name = “admin”; then I do String charValue = name.substring(0,1); //charValue=”a” I want to convert the charValue to its ASCII value (97), how can I do this in java? 22 Answers 22

HTML code for an apostrophe

May 24, 2022 by IT Nursery

Seemingly simple, but I cannot find anything relevant on the web. What is the correct HTML code for an apostrophe? Is it ’? 17 Answers 17

How to check if a string in Python is in ASCII?

May 23, 2022 by IT Nursery

I want to I check whether a string is in ASCII or not. I am aware of ord(), however when I try ord(‘é’), I have TypeError: ord() expected a character, but string of length 2 found. I understood it is caused by the way I built Python (as explained in ord()‘s documentation). Is there another … Read more

What is ANSI format?

May 22, 2022 by IT Nursery

What is ANSI encoding format? Is it a system default format? In what way does it differ from ASCII? 10 Answers 10

How can you strip non-ASCII characters from a string? (in C#)

May 20, 2022 by IT Nursery

How can you strip non-ASCII characters from a string? (in C#) 12 Answers 12

What is a vertical tab?

May 20, 2022 by IT Nursery

What was the original historical use of the vertical tab character (\v in the C language, ASCII 11)? Did it ever have a key on a keyboard? How did someone generate it? Is there any language or system still in use today where the vertical tab character does something interesting and useful? 9 Answers 9

Replace non-ASCII characters with a single space

May 17, 2022 by IT Nursery

I need to replace all non-ASCII (\x00-\x7F) characters with a space. I’m surprised that this is not dead-easy in Python, unless I’m missing something. The following function simply removes all non-ASCII characters: def remove_non_ascii_1(text): return ”.join(i for i in text if ord(i)<128) And this one replaces non-ASCII characters with the amount of spaces as per … Read more

Unicode, UTF, ASCII, ANSI format differences

May 9, 2022 by IT Nursery

What is the difference between the Unicode, UTF8, UTF7, UTF16, UTF32, ASCII, and ANSI encodings? In what way are these helpful for programmers? 2 Answers 2