Tag: flume

  • Hadoop 2.2 and Flume 1.4 Protobuf Problem and Solution

    I have to say the big THANK to the author of  “Hadoop in Practice” : Alex Holmes Source : http://grepalex.com/2014/02/09/flume-and-hadoop-2.2/ The problem you may encounter while  trying to integrate Hadoop 2.2 and Flume 1.4 is the incompatibility between protobuf versions : 2014-04-15 13:56:23,251 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR – org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:422)] process failed java.lang.VerifyError: class org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$RecoverLeaseRequestProto overrides final method getUnknownFields.()Lcom/google/protobuf/UnknownFieldSet; […]