Getting unwanted characters for apostrophe when reading data from a “|” (pipe) separated text file in R










2















I am trying to read data from a text file that contains data in the following format:



583550348352212992|Thu Apr 02 08:43:39 +0000 2015|Ambulance progress 'not fast enough' http://bbc.in/1P1AJyX
583406140337164288|Wed Apr 01 23:10:37 +0000 2015|Children’s hospital builds sleep app http://bbc.in/1BO9jlZ


I'm using the read.table function as follows:



bbchealth <- read.table(file=".../bbchealth.txt", 
sep="|",
header = F,
quote="",
fill=F,
stringsAsFactors = F,
numerals ="no.loss",
col.names = c("TweetId", "Date and Time", "Tweet"))


When I read the file, I see this:



583550348352212992 Thu Apr 02 08:43:39 +0000 2015 Ambulance progress 'not fast enough' http://bbc.in/1P1AJyX
583406140337164288 Wed Apr 01 23:10:37 +0000 2015 Children’s hospital builds sleep app http://bbc.in/1BO


As you can see, the apostrophe in "Childrens" has been changed to ’.



This is the case wherever the apostrophe appears (even in the inverted form).



574407194961039360|Sun Mar 08 03:12:01 +0000 2015|Frankie the dog ‘sniffs out cancer’ http://bbc.in/1COjVHM


is read as



574407194961039360 Sun Mar 08 03:12:01 +0000 2015 Frankie the dog ‘sniffs out cancer’ http://bbc.in/1COjVHM


Here, is converted into ‘ and into ’.



How can I ensure that these symbols are read as they are.










share|improve this question




























    2















    I am trying to read data from a text file that contains data in the following format:



    583550348352212992|Thu Apr 02 08:43:39 +0000 2015|Ambulance progress 'not fast enough' http://bbc.in/1P1AJyX
    583406140337164288|Wed Apr 01 23:10:37 +0000 2015|Children’s hospital builds sleep app http://bbc.in/1BO9jlZ


    I'm using the read.table function as follows:



    bbchealth <- read.table(file=".../bbchealth.txt", 
    sep="|",
    header = F,
    quote="",
    fill=F,
    stringsAsFactors = F,
    numerals ="no.loss",
    col.names = c("TweetId", "Date and Time", "Tweet"))


    When I read the file, I see this:



    583550348352212992 Thu Apr 02 08:43:39 +0000 2015 Ambulance progress 'not fast enough' http://bbc.in/1P1AJyX
    583406140337164288 Wed Apr 01 23:10:37 +0000 2015 Children’s hospital builds sleep app http://bbc.in/1BO


    As you can see, the apostrophe in "Childrens" has been changed to ’.



    This is the case wherever the apostrophe appears (even in the inverted form).



    574407194961039360|Sun Mar 08 03:12:01 +0000 2015|Frankie the dog ‘sniffs out cancer’ http://bbc.in/1COjVHM


    is read as



    574407194961039360 Sun Mar 08 03:12:01 +0000 2015 Frankie the dog ‘sniffs out cancer’ http://bbc.in/1COjVHM


    Here, is converted into ‘ and into ’.



    How can I ensure that these symbols are read as they are.










    share|improve this question


























      2












      2








      2








      I am trying to read data from a text file that contains data in the following format:



      583550348352212992|Thu Apr 02 08:43:39 +0000 2015|Ambulance progress 'not fast enough' http://bbc.in/1P1AJyX
      583406140337164288|Wed Apr 01 23:10:37 +0000 2015|Children’s hospital builds sleep app http://bbc.in/1BO9jlZ


      I'm using the read.table function as follows:



      bbchealth <- read.table(file=".../bbchealth.txt", 
      sep="|",
      header = F,
      quote="",
      fill=F,
      stringsAsFactors = F,
      numerals ="no.loss",
      col.names = c("TweetId", "Date and Time", "Tweet"))


      When I read the file, I see this:



      583550348352212992 Thu Apr 02 08:43:39 +0000 2015 Ambulance progress 'not fast enough' http://bbc.in/1P1AJyX
      583406140337164288 Wed Apr 01 23:10:37 +0000 2015 Children’s hospital builds sleep app http://bbc.in/1BO


      As you can see, the apostrophe in "Childrens" has been changed to ’.



      This is the case wherever the apostrophe appears (even in the inverted form).



      574407194961039360|Sun Mar 08 03:12:01 +0000 2015|Frankie the dog ‘sniffs out cancer’ http://bbc.in/1COjVHM


      is read as



      574407194961039360 Sun Mar 08 03:12:01 +0000 2015 Frankie the dog ‘sniffs out cancer’ http://bbc.in/1COjVHM


      Here, is converted into ‘ and into ’.



      How can I ensure that these symbols are read as they are.










      share|improve this question
















      I am trying to read data from a text file that contains data in the following format:



      583550348352212992|Thu Apr 02 08:43:39 +0000 2015|Ambulance progress 'not fast enough' http://bbc.in/1P1AJyX
      583406140337164288|Wed Apr 01 23:10:37 +0000 2015|Children’s hospital builds sleep app http://bbc.in/1BO9jlZ


      I'm using the read.table function as follows:



      bbchealth <- read.table(file=".../bbchealth.txt", 
      sep="|",
      header = F,
      quote="",
      fill=F,
      stringsAsFactors = F,
      numerals ="no.loss",
      col.names = c("TweetId", "Date and Time", "Tweet"))


      When I read the file, I see this:



      583550348352212992 Thu Apr 02 08:43:39 +0000 2015 Ambulance progress 'not fast enough' http://bbc.in/1P1AJyX
      583406140337164288 Wed Apr 01 23:10:37 +0000 2015 Children’s hospital builds sleep app http://bbc.in/1BO


      As you can see, the apostrophe in "Childrens" has been changed to ’.



      This is the case wherever the apostrophe appears (even in the inverted form).



      574407194961039360|Sun Mar 08 03:12:01 +0000 2015|Frankie the dog ‘sniffs out cancer’ http://bbc.in/1COjVHM


      is read as



      574407194961039360 Sun Mar 08 03:12:01 +0000 2015 Frankie the dog ‘sniffs out cancer’ http://bbc.in/1COjVHM


      Here, is converted into ‘ and into ’.



      How can I ensure that these symbols are read as they are.







      r






      share|improve this question















      share|improve this question













      share|improve this question




      share|improve this question








      edited Nov 14 '18 at 21:44







      Anonymouse

















      asked Nov 14 '18 at 19:41









      AnonymouseAnonymouse

      527




      527






















          1 Answer
          1






          active

          oldest

          votes


















          1














          Try encoding="UTF-8" parameter in read.table().






          share|improve this answer






















            Your Answer






            StackExchange.ifUsing("editor", function ()
            StackExchange.using("externalEditor", function ()
            StackExchange.using("snippets", function ()
            StackExchange.snippets.init();
            );
            );
            , "code-snippets");

            StackExchange.ready(function()
            var channelOptions =
            tags: "".split(" "),
            id: "1"
            ;
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function()
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled)
            StackExchange.using("snippets", function()
            createEditor();
            );

            else
            createEditor();

            );

            function createEditor()
            StackExchange.prepareEditor(
            heartbeatType: 'answer',
            autoActivateHeartbeat: false,
            convertImagesToLinks: true,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: 10,
            bindNavPrevention: true,
            postfix: "",
            imageUploader:
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            ,
            onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            );



            );













            draft saved

            draft discarded


















            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53307663%2fgetting-unwanted-characters-for-apostrophe-when-reading-data-from-a-pipe-s%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown

























            1 Answer
            1






            active

            oldest

            votes








            1 Answer
            1






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes









            1














            Try encoding="UTF-8" parameter in read.table().






            share|improve this answer



























              1














              Try encoding="UTF-8" parameter in read.table().






              share|improve this answer

























                1












                1








                1







                Try encoding="UTF-8" parameter in read.table().






                share|improve this answer













                Try encoding="UTF-8" parameter in read.table().







                share|improve this answer












                share|improve this answer



                share|improve this answer










                answered Nov 14 '18 at 21:54









                phili_bphili_b

                8611




                8611





























                    draft saved

                    draft discarded
















































                    Thanks for contributing an answer to Stack Overflow!


                    • Please be sure to answer the question. Provide details and share your research!

                    But avoid


                    • Asking for help, clarification, or responding to other answers.

                    • Making statements based on opinion; back them up with references or personal experience.

                    To learn more, see our tips on writing great answers.




                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function ()
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53307663%2fgetting-unwanted-characters-for-apostrophe-when-reading-data-from-a-pipe-s%23new-answer', 'question_page');

                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    這個網誌中的熱門文章

                    What does pagestruct do in Eviews?

                    Dutch intervention in Lombok and Karangasem

                    Channel Islands