發表文章

目前顯示的是 2月 21, 2019的文章

The loading of parquet files from HDFS is slower that the loading from S3. What can be the reasons for that?

圖片
0 I have hundreds of parquet files in HDFS. I also have the same files in AWS S3. On a EMR cluster, I run a machine learning model, which can take its learning data from HDFS or from S3. When it loads the data from HDFS, it takes a longer time than when the data is loaded from S3. Should not it be the opposite ? What can be the reason(s) for that? Obviously, the hardware (the machines) used in the EMR cluster is the same for both cases. hadoop amazon-s3 share | improve this question asked Nov 14 '18 at 16:52 Benjamin Dupuis Benjamin Dupuis 1 2 add a comment  |  0 I have hundreds of parquet files in HDFS. I also have the same files in AWS S3. On a EMR cluster, I run a machine learning model, which can take its learning data from HDFS or from S3. When it loads the data from HDFS, it takes a longer time than when the data is loaded from S3. Should not it be the opposite ? What can be the reason(s) for that? Obviously, t

Hong Kong Island (constituency)

圖片
Hong Kong Island Geographical Constituency for the Legislative Council of Hong Kong Boundary of Hong Kong Island in Hong Kong District Central and Western District Wan Chai District Eastern District Southern District Region Hong Kong Island Electorate 623,273 Current constituency Created 1998 Number of members 6 Member(s) Pro-Beijing (3) :      Regina Ip (NPP)      Kwok Wai-keung (FTU)      Horace Cheung (DAB) Pro-democracy (3) :      Hui Chi-fung (Democratic)      Tanya Chan (Civic)      Au Nok-hin (Ind) Created from Hong Kong Island Central, Hong Kong Island West, Hong Kong Island South, Hong Kong Island East The Hong Kong Island geographical constituency is one of the five geographical constituencies in the elections for the Legislative Council of Hong Kong. It currently elects 6 Members of the Legislative Council using the Hare quota of party-list proportional representation. The constituency covers all the four districts on the Hong Kong Island, namely, Central and Western,