這篇文章主要介紹了HDFS如何實現讀寫操作,具有一定借鑒價值,感興趣的朋友可以參考下,希望大家閱讀完這篇文章之后大有收獲,下面讓小編帶著大家一起了解一下。
import java.io.OutputStream;
import java.net.URI;
import java.net.URL;
import org.apache.commons.io.IOUtils;
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.fs.FSDataInputStream;
import org.apache.hadoop.fs.FileSystem;
import org.apache.hadoop.fs.FsUrlStreamHandlerFactory;
import org.apache.hadoop.fs.Path;
public class HdfsTest {
public static void main(String[] args) throws Exception {
write();
}
public static void read1(String url) throws Exception {
URL.setURLStreamHandlerFactory(new FsUrlStreamHandlerFactory());
System.out.println(IOUtils.toString(new URL(url).openStream()));
}
public static void read2(String url) throws Exception {
Configuration conf = new Configuration();
FileSystem fs = FileSystem.get(URI.create(url), conf);
FSDataInputStream is = fs.open(new Path(url));
System.out.println(IOUtils.toString(is));
is.close();
fs.close();
}
public static void write() throws Exception {
String hdfsFile = "hdfs://192.168.202.134:9000/test/text2.txt";
Configuration conf = new Configuration();
FileSystem fs = FileSystem.get(URI.create(hdfsFile), conf, "andy");
OutputStream out = fs.create(new Path(hdfsFile), true);
out.write("new file text2.txt".getBytes());
out.close();
fs.close();
read1(hdfsFile);
read2(hdfsFile);
}
}
感謝你能夠認真閱讀完這篇文章,希望小編分享的“HDFS如何實現讀寫操作”這篇文章對大家有幫助,同時也希望大家多多支持億速云,關注億速云行業資訊頻道,更多相關知識等著你來學習!
免責聲明:本站發布的內容(圖片、視頻和文字)以原創、轉載和分享為主,文章觀點不代表本網站立場,如果涉及侵權請聯系站長郵箱:is@yisu.com進行舉報,并提供相關證據,一經查實,將立刻刪除涉嫌侵權內容。