{"id":20050,"date":"2022-09-18T22:53:00","date_gmt":"2022-09-18T17:23:00","guid":{"rendered":"https:\/\/www.mygreatlearning.com\/blog\/regular-expression-in-python\/"},"modified":"2024-11-18T18:19:28","modified_gmt":"2024-11-18T12:49:28","slug":"regular-expression-in-python","status":"publish","type":"post","link":"https:\/\/www.mygreatlearning.com\/blog\/regular-expression-in-python\/","title":{"rendered":"Introduction to Regular Expression in Python | Regex in Python"},"content":{"rendered":"\n

Regular Expression(regex or RE for short) as the name suggests is an expression which contains a sequence of characters that define a search pattern. Take an example of this simple Regular Expression :<\/p>\n\n\n\n

\\b[a-zA-Z0-9._%+-]+@[a-zA-Z0-9.-]+\\.[a-zA-Z]{2,}\\b <\/pre>\n\n\n\n
This expression can be used to find all the possible emails in a large corpus of text. This is useful because otherwise, you will have to manually go through the whole text document and find every email id in it. After going through this article you\u2019ll know how the above Regular Expression works and much more. We can use different programming languages such as Java<\/a>, Python<\/a>, JavaScript<\/a>, PHP and many more to implement Regular Expressions but there are certain variations in its implementation across these languages. So now let us see the subtopics we are going to cover in this article:<\/p>\n\n\n\n
    \n
  1. What is Regular Expression in Python?<\/a><\/li>\n\n\n\n
  2. How to write Regular Expression in Python?<\/a><\/li>\n\n\n\n
  3. Examples of Regular Expression in Python<\/a><\/li>\n\n\n\n
  4. Regular Expression program in Python<\/a>\n
      \n
    1. Email Validation in Python using Regular Expression<\/a><\/li>\n\n\n\n
    2. Validate mobile number using Regular Expression in Python<\/a><\/li>\n<\/ol>\n<\/li>\n<\/ol>\n\n\n\n
      What is Regular Expression in Python?<\/strong><\/h2>\n\n\n\n
      In Python, a Regular Expression (REs, regexes or regex pattern) are imported through re module which is an ain-built in Python so you don\u2019t need to install it separately.<\/p>\n\n\n\n
      The re module offers a set of functions that allows us to search a string for a match:<\/p>\n\n\n\n
      Function<\/strong><\/td> Description<\/strong> <\/td><\/tr>
      findall<\/td>  Returns a list containing all matches   <\/td><\/tr>
       compile <\/td>  Returns a regex objec <\/td><\/tr>
       search <\/td> Returns a Match object if there is a match anywhere in the string <\/td><\/tr>
       split <\/td>  Returns a list where the string has been split at each match <\/td><\/tr>
       sub <\/td> Replaces one or many matches with a string <\/td><\/tr>
       subn     <\/td> Similar to sub except it returns a tuple of 2 items containing the new string and the number of substitutions made. <\/td><\/tr>
       group  <\/td> Returns a tuple containing all the subgroups of the match, from 1 up to however many groups are in the pattern  <\/td><\/tr>
       match <\/td> Similar to search, but only searches in the first line of the text  <\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n
      We shall use all of these methods once we know how to write Regular Expressions which we will learn in the next section.<\/p>\n\n\n\n
      How to write Regular Expression in Python?<\/strong><\/h2>\n\n\n\n
      To learn how to write RE, let us first clarify some of the basics. In RE we use either literals or meta characters.literals are the characters themselves and have no special meaning. Here is an example in which I use literals to find a specific string in the text using findall method of re module.<\/p>\n\n\n\n
      import re\nstring=\"Hello my name is Hussain\"\nprint(re.findall(r\"Hussain\",string))<\/code><\/pre>\n\n\n\n
      Output:<\/p>\n\n\n\n
      ['Hussain']<\/p>\n\n\n\n
      As you can see we used the word \u2018Hussain\u2019 itself to find it in the text. This may not seem a good idea when we have to extract thousands of names from a corpus of text. To do that we need to find a specific pattern and use meta-characters.<\/p>\n\n\n\n
      Meta-characters <\/strong><\/h4>\n\n\n\n
      Metacharacters are characters with a special meaning and they are not interpreted as they are which is in the case of literals. We may further classify meta-characters into identifier and modifiers.<\/p>\n\n\n\n
      Identifiers are used to recognise a certain type of characters. For example, to find all the number characters in a string we can use an identifier \u2018\/d\u2019<\/p>\n\n\n\n
      import re\nstring=\"Hello I live on street 9 which is near street 23\"\nprint(re.findall(r\"\\d\",string))<\/code><\/pre>\n\n\n\n
      Output:<\/p>\n\n\n\n
      ['9', '2', '3']<\/p>\n\n\n\n
      But there seems to be a problem with this. It only returns single-digit numbers and even worst even split the number 23 into two digits. So how can we tackle this problem, can using two \\d help?<\/p>\n\n\n\n
      import re\nstring=\"Hello I live on street 9 which is near street 23\"\nprint(re.findall(r\"\\d\\d\",string))<\/code><\/pre>\n\n\n\n
      Output:<\/p>\n\n\n\n
      ['23']<\/p>\n\n\n\n
      Using two identifiers did help, but now it can only find two-digit numbers, which is not what we wanted.<\/p>\n\n\n\n
      One way to solve this problem will be modifiers, but first, here are some identifiers that we can use in Python. We shall use some of them in the examples we are going to do in the next section. <\/p>\n\n\n\n
       \\d = any number\n\\D = anything but a number\n\\s = space\n\\S = anything but a space\n\\w = any letter\n\\W = anything but a letter\n. = any character, except for a new line\n\\b = space around whole words\n\\. = period. must use a backslash, because \u2018 . \u2018 normally means any character.<\/pre>\n\n\n\n
      Modifiers are a set of meta-characters that add more functionality to identifiers. Going back to the example above, we will see how we can use a modifier \u201c + \u201d to get numbers of any length from the string. This modifier returns a string when it matches 1 or more characters.<\/p>\n\n\n\n
      import re\nstring=\"Hello I live on street 9 which is near street 23\"\nprint(re.findall(r\"\\d+\",string))<\/code><\/pre>\n\n\n\n
      Output:<\/p>\n\n\n\n
      ['9', '23']<\/p>\n\n\n\n
      Great! finally, we got our desired results. By using \u2018+\u2019 modifier with the \/d identifier, I can extract numbers of any length. Here are few of the modifiers that we are also going to use in the examples section ahead.<\/p>\n\n\n\n
       + = match 1 or more\n? = match 0 or 1 repetitions.\n* = match 0 or MORE repetitions\n$ = matches at the end of string\n^ = matches start of a string\n| = matches either\/or. Example x|y = will match either x or y\n[] = A set of characters in which we define range, or \"variance\"\n{x} = expect to see this amount of the preceding code.\n{x,y} = expect to see this x-y amounts of the precedng code<\/pre>\n\n\n\n
      Did you notice we are using the r character at the start of all RE, this r is called a raw string literal. It changes how the string literal is interpreted. Such literals are stored as they appear.<\/p>\n\n\n\n
      For example, \\ is interpreted as an escape sequence usually but it is just a backslash when prefixed with an r.  You will see what this means with special characters. Sometimes, the syntax involves backslash-escaped characters, and to prevent these characters from being interpreted as escape sequences we use this raw string literals.<\/p>\n\n\n\n
      Examples of Regular Expression in Python<\/strong><\/h2>\n\n\n\n
      Let us explore some of the examples related to the meta-characters. Here we are going to see how we use different meta-characters and what effect do they have on output:<\/p>\n\n\n\n
      import re\nstring=\"get out Of my house !!!\"\nprint(re.findall(r\"\\w+\",string))<\/code><\/pre>\n\n\n\n
      Output:<\/p>\n\n\n\n
      ['get', 'out', 'Of', 'my', 'house']<\/p>\n\n\n\n
      import re\nstring=\"get out Of my house !!!\"\nprint(re.findall(r\"\\w{2}\",string))<\/code><\/pre>\n\n\n\n
      Output:<\/p>\n\n\n\n
      ['et', 'ut', 'Of', 'my', 'se'] <\/p>\n\n\n\n
      import re\nstring=\"abc abcccc abbbc ac def\"\nprint(re.findall(r\"\\bab*c\\b\",string))<\/code><\/pre>\n\n\n\n
      Output:<\/p>\n\n\n\n
      ['abc', 'abbbc', 'ac'] <\/p>\n\n\n\n
      import re\nstring=\"abc abcccc abbbc ac def\"\nprint(re.findall(r\"\\bab+c\\b\",string))<\/code><\/pre>\n\n\n\n
      Output:<\/p>\n\n\n\n
      ['abc', 'abbbc']  <\/p>\n\n\n\n
      import re\nstring=\"get out Of my house !!!\"\nprint(re.findall(r\"\\b\\w{2}\\b\",string))<\/code><\/pre>\n\n\n\n
      Output:<\/p>\n\n\n\n
      ['Of', 'my'] <\/p>\n\n\n\n
      import re\nstring=\"name and names are 23 blah blah\"\nprint(re.findall(r\"\\b\\w+es?\\b\",string))<\/code><\/pre>\n\n\n\n
      Output:<\/p>\n\n\n\n
      ['name', 'names', 'are'] <\/p>\n\n\n\n
      import re\nstring='''I am Hussain Mujtaba and M12  !a\n'''\nprint(re.findall(r\"M.....a\",string))<\/code><\/pre>\n\n\n\n
      Output:<\/p>\n\n\n\n
      ['Mujtaba', 'M12  !a'] <\/p>\n\n\n\n
      import re\nstring='''123345678\n'''\nprint(re.findall(r\"[123]\",string))<\/code><\/pre>\n\n\n\n
      Output:<\/p>\n\n\n\n
      ['1', '2', '3', '3']<\/p>\n\n\n\n
      import re\n string='''123345678\n '''\n print(re.findall(r\"[^123]\",string))<\/code><\/pre>\n\n\n\n
      Output:<\/p>\n\n\n\n
      ['4', '5', '6', '7', '8', '\\n'] <\/p>\n\n\n\n
      import re\nstring='''\nhello I am a student from India\n'''\nprint(re.findall(r\"[A-Z][a-z]+\",string))<\/code><\/pre>\n\n\n\n
      Output:<\/p>\n\n\n\n
      ['India'] <\/p>\n\n\n\n
      import re\nstring='''\nhello I am a student from India\n'''\nprint(re.findall(r\"\\b[A-Ia-i][a-z]+\\b\",string))<\/code><\/pre>\n\n\n\n
      Output:<\/p>\n\n\n\n
      ['hello', 'am', 'from', 'India'] <\/p>\n\n\n\n
      import re\nstring='''\nhello I am a student from India. Hello again\n'''\nprint(re.findall(r\"\\b[h|H]\\w+\\b\",string))<\/code><\/pre>\n\n\n\n
      Output:<\/p>\n\n\n\n
      ['hello', 'Hello']  <\/p>\n\n\n\n
      import re\nstring='''\nhello I am a student from India and heere is now\n'''\nprint(re.findall(r\"([a-z])\\1\",string))<\/code><\/pre>\n\n\n\n
      Output:<\/p>\n\n\n\n
      ['l', 'e']<\/p>\n\n\n\n
      Now that we have seen enough of meta-characters, we will see how some of the methods of re module work. First, let us start with re.compile<\/p>\n\n\n\n
      re.compile<\/h4>\n\n\n\n
      We can combine a regular expression pattern into pattern objects, which can be used for pattern matching. It also helps to search a pattern again without rewriting it. Here is an example:<\/p>\n\n\n\n
      import re\npattern=re.compile('[A-Z][a-z]+')\nresult=pattern.findall('Great Learning is all about excellence')\nprint(result)<\/code><\/pre>\n\n\n\n
      Output: <\/p>\n\n\n\n
      ['Great', 'Learning'] <\/p>\n\n\n\n
      re.search<\/h4>\n\n\n\n
      The re.search function searches the string for a match and returns a Match object if there is a match. If there is more than one match, only the first occurrence of the match will be returned. Here is an example:<\/p>\n\n\n\n
      import re\ntxt = \"The rain in Spain\"\nprint(re.search(\"Spain\", txt))<\/code><\/pre>\n\n\n\n
      Output:<\/p>\n\n\n\n
      <_sre.SRE_Match object; span=(12, 17), match='Spain'> <\/p>\n\n\n\n
      re.split<\/h4>\n\n\n\n
      The re.split function returns a list where the string has been split at each match:<\/p>\n\n\n\n
      import re\ns_nums = 'one1two22three333four'\nprint(re.split('\\d+', s_nums))<\/code><\/pre>\n\n\n\n
      Output:<\/p>\n\n\n\n
      ['one', 'two', 'three', 'four']<\/p>\n\n\n\n
      re.sub<\/h4>\n\n\n\n
      The re.sub function replaces the matches with the text of your choice<\/p>\n\n\n\n
      import re\ns = 'aaa@xxx.com bbb@yyy.com ccc@zzz.com'\nprint(re.sub('[a-z]*@', 'XXX@', s))<\/code><\/pre>\n\n\n\n
      XXX@xxx.com XXX@yyy.com XXX@zzz.com<\/pre>\n\n\n\n
      re.subn<\/h4>\n\n\n\n
      As mentioned earlier, re.subn function is similar to re.sub function but it returns a tuple of 2 items containing the new string and the number of substitutions made.<\/p>\n\n\n\n
      import re\ns = 'aaa@xxx.com bbb@yyy.com ccc@zzz.com'\nprint(re.subn('[a-z]*@', 'XXX@', s))<\/code><\/pre>\n\n\n\n
       ('XXX@xxx.com XXX@yyy.com XXX@zzz.com', 3) <\/pre>\n\n\n\n
      re.match<\/h4>\n\n\n\n
      re.match function will search the regular expression pattern and return the first occurrence. This method checks for a match only at the beginning of the string. So, if a match is found in the first line, it returns the match object. But if a match is found in some other line, it returns null. Here is an example:<\/p>\n\n\n\n
      import re \nString ='''learning regex with \n           great learning is easy \n           also regex is very useful for string matching. \n           It is fast too.'''\n  \n# Use of re.search() Method \nprint(re.search('learning', String)) \n# Use of re.match() Method \nprint(re.match('learning', String)) \n# Use of re.search() Method \nprint(re.search('great learning', String)) \n# Use of re.match() Method \nprint(re.match('great learning', String)) <\/code><\/pre>\n\n\n\n
      Output:<\/p>\n\n\n\n
      <_sre.SRE_Match object; span(0, 8), match='learning'>                                                                         <_sre.SRE_Match object; span(0, 8), match='learning'>                                                                         <_sre.SRE_Match object; span(32, 46), match='great learning'>                                                                 None   <\/p>\n\n\n\n
      re.group<\/h4>\n\n\n\n
      The re.group function returns entire match (or specific subgroup num).We can mention subgroups in Regular expression if we enclose them in parentheses.Here is an example to make it clear<\/p>\n\n\n\n
      import re\nstring = \"Dogs are more loyal than cats\"\nmatchObj = re.match( r'(.*) are (.*?) .*', string)\nprint (\"matchObj.group() : \", matchObj.group(0))\nprint (\"matchObj.group(1) : \", matchObj.group(1))\nprint (\"matchObj.group(2) : \", matchObj.group(2))\n<\/code><\/pre>\n\n\n\n
      Output:<\/p>\n\n\n\n
      matchObj.group() :  Dogs are more loyal than cats                                                                              matchObj.group(1) :  Dogs                                                                                                      matchObj.group(2) :  more  <\/p>\n\n\n\n
      We define a group in Regular expression by enclosing them in parenthesis. As you can see we have defined two groups in the above Regular Expression, one is before are and another is after it. Thus in group 1, we have dogs and in group 2 we have more.<\/p>\n\n\n\n
      Regular Expression program in Python<\/strong><\/h2>\n\n\n\n
      Now that we have seen how to use different RE, we are going to use them to write certain programs. So let us first write a program that can validate email id.<\/p>\n\n\n\n
      Email Validation in Python using Regular Expression<\/strong><\/h3>\n\n\n\n
      This program is going to take in different email ids and check if the given email id is valid or not. First, we will find patterns in different email id and then depending on that we design a RE that can identify emails. Now let us take look at some valid emails:<\/p>\n\n\n\n