hbase 1 « hbase « Java Database Q&A





1. Is HBase stable and production-ready?    stackoverflow.com

For folks who have deployed HBase on their own clusters, do you feel that it's sufficiently stable for production use? What types of troubles or issues have you run into? I ...

2. secondary index on column store dbs    stackoverflow.com

Is there any column store database that supports secondary index ? I know HBase does, but it's not there yet. Haggai.

3. Looking for a good HBase tutorial    stackoverflow.com

I'm looking for a good and tested HBase tutorial, where I can find one?

4. i got this exception while i run hbase client    stackoverflow.com

import java.io.IOException;

import org.apache.hadoop.hbase.HBaseConfiguration;
import org.apache.hadoop.hbase.client.Get;
import org.apache.hadoop.hbase.client.HTable;
import org.apache.hadoop.hbase.client.Put;
import org.apache.hadoop.hbase.client.Result;
import org.apache.hadoop.hbase.client.ResultScanner;
import org.apache.hadoop.hbase.client.Scan;
import org.apache.hadoop.hbase.util.Bytes;



public class HBaseExample {
  public static void main(String[] args) throws IOException {

    HBaseConfiguration config = new HBaseConfiguration();

  ...

5. Using Hbase with C#    stackoverflow.com

How can I use a Hbase database with C#/VB.NET ? (use=connect, query, get the result, insert, update, delete) I don't find useful answers with google.

6. How to read data from Hbase?    stackoverflow.com

Hi there I'm use to SQL, but I need to read data from a HBase table. Any help on this would be great. A book or maybe just some sample code ...

7. How to improve HBase Scanner?    stackoverflow.com

Ho do I configure HBase so that the scanner only retrieves a number of records at a time? Or how do I improve the scanner when the database contains a lot ...

8. web Interface for HBase data access    stackoverflow.com

I want a web interface for viewing data in HBase (like phpMyAdmin is for mySQL but for HBase). Are there any existing solutions/tools out there?

9. Referential Integrity and HBase    stackoverflow.com

One of the first sample schemas you read about in the HBase FAQ is the Student-Course example for a many-many relationship. The schema has a Courses column in the Student table ...





10. Problem with zohmg data import into hbase    stackoverflow.com


I have used zohmg and successfully created mapper, table in HBase and test-imported my data (using --local switch).
But I have problem inserting my data after mapping into HBase, this is error ...

11. send Hbase batch Puts compressed?    stackoverflow.com

Is there a way to send a batch of hbase puts, compressed. I'm setting auto flush to false and I'm using a bufferSize of 2MG. Is there a way to compress the ...

12. Retrieving information from aggregated weblogs data, how to do it?    stackoverflow.com

I would like to know how to retrieve data from aggregated logs? This is what I have:
- about 30GB daily of uncompressed log data loaded into HDFS (and this will grow ...

13. Problem with HBase in classpath    stackoverflow.com


I'm having problem with using external jars in my file. I always get
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/HBaseConfiguration
at this line: Configuration config = HBaseConfiguration.create();
And this file is on the classpath, I'm ...

14. multiple or bulk fetch or get in HBase Java client?    stackoverflow.com

Does the HBase Java client support multi-get (aka bulk fetch), kind of like memcached multi-get? I've scoured the docs and the Internet for at least an hour and couldn't find ...

15. Hbase and 1- Many Relation    stackoverflow.com

I have one question which can be best described by the following scenario. Suppose I have three tables BaseCategory,Category and products. If i am thinking in terms of RDBMS then the relationship ...

16. How do you use a custom comparator with SingleColumnValueFilter on HBase?    stackoverflow.com

I am trying to filter rows from a HBase table using two SingleColumnValueFilter objects to bring back all records that fall within a range of long values for the ...





17. is there a way to rollback hbase    stackoverflow.com

Is there a way to rollback values to a previous stage at cell level (row level might work also) I imported a file with wrong data and I just need to go ...

18. getting rid of Hbase configuration deprecated warning    stackoverflow.com

I'm getting this error message in my log file WARN hbase.HBaseConfiguration: instantiating HBaseConfiguration() is deprecated. Please use HBaseConfiguration#create() to construct a plain Configuration how can I get rid of this? ...

19. How to store complex objects into hadoop Hbase?    stackoverflow.com

I have complex objects with collection fields which needed to be stored to Hadoop. I don't want to go through whole object tree and explicitly store each field. So I just ...

20. Using HBase to store time series data    stackoverflow.com

We are trying to use HBase to store time-series data. The model we have currently stores the time-series as versions within a cell. This implies that the cell could end up ...

21. Difference between a row-oriented and column-oriented databases in dealing information retrieval    stackoverflow.com

Recently, I started working on HBase (one of the column-oriented databases). While going through the source code, one question keeps popping in my head. Thought of asking this. My question is, how ...

22. Data Visualization & HBase    stackoverflow.com

Greetings, I have been looking through the questions on this site and I haven't found any related questions. I have currently built a Flex/PHP/MySQL app where I take an extract from my Hadoop ...

23. HBase binary key type via Stargate    stackoverflow.com

is there a way to request a binary key type (int, byte array) instead of string using HBase's Stargate?

24. HBase record lost upon closing    stackoverflow.com

HI, I install Hbase 0.89 (oct release) using local filesystem, for dev and test purpose. I created few tables and rows using hbase shell. somehow whenever i restart hbase, no data/table ...

25. hbase error: "10/12/26 06:48:07 INFO ipc.HbaseRPC: Server at /127.0.0.1:58920 could not be reached after 1 tries, giving up."    stackoverflow.com

Dose anyone know what's wrong with hbase? I am using vm image of cloudera distribution for hadoop, previously it was working fine but now giving me this error after every second ...

26. Storing objects and relationships between them in HBase    stackoverflow.com

I'm starting a personal project that involves storing a large database of objects and the relationships between objects. I chose Hadoop and HBase because it will need to be multi node ...

27. HBase via JRuby suggestions?    stackoverflow.com

The HBase shell is now based on jirb, the JRuby implementation of the interactive ruby shell irb. Are there any nice tricks for interacting with HBase in JRuby ...

28. Replicating a standalone HBase 0.2 deployment    stackoverflow.com

As far as I'm aware the current stable release of HBase, 0.2, does not support replication, although it is being built into the next version. How would you recommend replicating ...

29. HBase NoServerForRegionException?    stackoverflow.com

I am getting this exception when for a while i didn't communicated with HBase: org.apache.hadoop.hbase.client.NoServerForRegionException: Timed out trying to locate root region because: Connection refused is this something related with session expiry, if ...

30. HBase Column RegEx through Thrift from C#    stackoverflow.com

I'm using the thrift interface (http://apache.mesi.com.ar//incubator/thrift/0.5.0-incubating/) to access HBase on my cluster. I can connect, get and display records; Use the start and stop dates. The documentation (http://hbase.apache.org/docs/r0.89.20100924/apidocs/org/apache/hadoop/hbase/thrift/doc-files/Hbase.html#Fn_Hbase_scannerOpenWithStop) ...

31. HBase connection exception    stackoverflow.com

I try to run HBase in a Pseudo-Distributed mode. But it doesn't work after I set hbase-site.xml. Each time I try to run a command inside hbase shell I get this ...

32. HBase java.lang.OutOfMemoryError    stackoverflow.com

I'm having the following issue with Hbase. I have a script which starts the HBase shell and inserts many rows into a table with a single column. I have tried inserting 10,000 ...

33. java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/MasterNotRunningException    stackoverflow.com

I created by own HBase java client code, but I am having a really difficult time compiling it and getting it to run. I am compiling from the command line, and ...

34. Looking for proper hbase-site.xml hbase-default.xml config example for HBase client    stackoverflow.com

I am trying to connect to an HBase node from a Java application. HBaseConfiguration is key, but the available Javadoc and documentation is really poor and insufficient. Does anyone have proper examples ...

35. Help: org.apache.hadoop.hbase.MasterNotRunningException 12.34.56.78:60000    stackoverflow.com

I am writting a small Java application to connect to a HBase node. The ZooKeeper connection is successful, but later, I systematically get the following error (I have changed my IP ...

36. ZookeeperConnectionException in HBase Standalone mode    stackoverflow.com

I'm using hbase-0.90.0. I'm running it in standalone mode. While trying to execute any commands from "hbase shell" it is giving me the following error. hbase(main):003:0> status 'detailed' ERROR: org.apache.hadoop.hbase.ZooKeeperConnectionException: org.apache.hadoop.hbase.ZooKeeperConnectionException: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode ...

37. HBase bulk load spawn high number of reducer tasks - any workaround    stackoverflow.com

HBase bulk load (using configureIncrementalLoad helper method) configures the job to create as many reducer task as the regions in the hbase table. So if there are few hundred regions then ...

38. ActiveMQ with HBase persistence    stackoverflow.com

Is it possible to use HBase as persistence database for ActiveMQ? Anyone had done something similar?

39. Any idea on how to write an Hadoop InputFormat / OutputFormat for Hbase    stackoverflow.com

Is anyone have some experience of writing a Hadoop InputFormat/OutputFormat that get their date from Hbase ? I'd like something more specific than the HbaseTableInputFormat because my idea is to return my ...

40. what is gora and its features?    stackoverflow.com

what is gora? what does it do for us? how it work with hbase? which features dose it have? do you know a good essay or web page which can help me? ...

41. ERROR: org.apache.hadoop.hbase.MasterNotRunningException: null+hbase+hadoop    stackoverflow.com


I have recently configured hadoop cluster with two machines(on ubuntu). It works fine so far. But when i try to configure hbase on the above hadoop cluster, it shows error. Here is ...

42. Is it possible to set where condition to hbase row-keys?    stackoverflow.com

Is it possible to set where condition to hbase row-keys? Suppose I have row-keys 1,2,3,4,5... I need to query like "where row-key<4"??

43. Problem with extending HBase Put    stackoverflow.com

I have a problem while trying to extend HBase Put class. I have a code like this

public class HBasePut extends Put {  
    //here i define ...

44. Which is better HBASE or Neo4j    stackoverflow.com

Hi guys i am analyzing few things for doing a Proof of concept. I want to convert a Employee payroll database to Nosql. Which is better to use HBASE or Neo4j? Or ...

45. HBase: How does replication work?    stackoverflow.com

I'm currently evaluating HBase as a Datastore, but one question was left unanswered: HBase stores many copies of the same object on many nodes (aka replication). As HBase features so-called strong ...

46. ETL associated with HADOOP database Hbase?    stackoverflow.com

HI can anybody tell me which are the ETL Tools which can be used with Hbase which is the database of hadoop? I mean to say like how the data in ...

47. Hbase multiple metrics    stackoverflow.com

Possible Duplicate:
HBase schema design
Hi, i want to have multiple metrics per dimension on my HBase table. For example 3 metrics for a bunch of 20 dimensions. What ...

48. Mutiple maps followed by one reduce with Hadoop and HBase    stackoverflow.com

I have several Hbase tables. I wish to run a map task on each table (each map being a different Mapper class since each table contains heterogeneous data) followed by ...

49. LIFO / sorted database design pattern    stackoverflow.com

I want to store data (as an archive) in two seperate lists one is to be a sort of LIFO stack where new data just gets pushed on top and the ...

50. hbase command versus hadoop command    stackoverflow.com

The little bit of description of hbase in the O'Reilly Elephant book shows the use of the 'hbase' command line wrapper to run a map-reduce job using hbase. However, our code has ...

51. HBase one to many 'relationship' storage    stackoverflow.com

I'm pondering the best way to implement a one to many relationship in HBase. Say an ACCOUNT has many TRANSACTION(s). Is it better to a) Add columns to a transactions: column family on ...

52. What to use for real-time log aggregation and quering?    stackoverflow.com


I'm searching for tool/database/solution that can help me with aggregating real-time logs and can query them also in real-time.
Basic requirement is ability to deliver results as soon as possible, keeping in ...

53. NativeException: org.apache.hadoop.hbase.MasterNotRunningException: null    stackoverflow.com

I have started Hadoop and Hbase successfully. But when I try this operation like, ./hbase shell HBase Shell; enter 'help' for list of supported commands. Version: 0.20.3, r902334, Mon Jan 25 13:13:08 PST 2010 hbase(main):001:0> ...

54. HBase - Column family    stackoverflow.com

I'm a beginner in HBase. I need to design my table. I want to play with the following information: At the date XX-XX-XXXX, the word 'HELLO' is in document 2,3,4 and the weight of ...

55. Hbase storage engine    stackoverflow.com

Any idea about the storage engine used in hbase?

56. Hbase-database configuration    stackoverflow.com

I'm new to Hbase.I have created a table using hbase shell.By default it's storing on /tmp folder. I want to change the storage location. where I should change the configuration. Thanks in ...

57. hbase database creation    stackoverflow.com

I m new to hbase.. There are some errors while creatin table in hbase

hbase(main):010:0> create 'test'
11/05/01 12:40:47 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 192.168.1.72:60020
11/05/01 12:40:47 DEBUG client.HConnectionManager$TableServers: Found ROOT at 192.168.1.72:60020
11/05/01 ...

58. Get all families in hbase    stackoverflow.com

I have a hbase table with

Rows: word, Families: date
I want to get a scanner for all the words at the date 'd', how I can do this? So ...

59. How to use HBase?    stackoverflow.com

I need help regarding database. I am trying to create a Java project which uses the data from 25 different XML files to display a graph. My question is can the ...

60. Is there any C library for HBase?    stackoverflow.com

I need HBase to store large amount of indexing keywords and values (currently using Redis), but I can't find any C library to connect, write or read HBase. I Googled, but found ...

61. Why won't Gradle pass dependency to compiler at testCompile phase?    stackoverflow.com

Running Gradle 1.0-milestone-3. I have a sub-project that depends on the following:

libraries.hbase = [ 
  'org.apache.hbase:hbase:0.90.3' 
] 

libraries.hbase_test = [ 
 'org.apache.hbase:hbase:0.90.3:tests' 
] 
The dependencies are defined as:
dependencies ...

62. HBase: How to delete region    stackoverflow.com

Due to legal issues I need to delete old data from HBase. I found a way to split the region using my criteria and by that moving the old data to the ...

63. Will using hadoop 20-append with hbase 90.3 break?    stackoverflow.com

Trying to install hbase, but the word on the street is that if I don't use a hadoop from the 20-append branch, I'll lose data. This tutorial says ...

64. HBase: how to filter by "key not start with"    stackoverflow.com

using PrefixFilter("word") it is possible to filter all keys which start with "word". I am trying to get the opposite, all key which not start with "word". Is it a filter which ,match ...

65. What is meant by sparse data/ datastore/ database?    stackoverflow.com

Have been reading up on Hadoop and HBase lately, and came across this term-

HBase is an open-source, distributed, sparse, column-oriented store...
What do they mean by sparse? Does it have ...

66. How to connect to remote HBase in Java?    stackoverflow.com

I have a standlone HBase server. This is my hbase-site.xml:

<configuration>
 <property>
    <name>hbase.rootdir</name>
    <value>file:///hbase_data</value>
  </property>
</configuration>
I am trying to write a Java program to manipulate ...

67. CompressionTest for LZO fails    stackoverflow.com

I sincerely thank you for reading my post. I'm trying to install LZO 2.03 compression codec on HBase on my server (running Xeon CPUs). I'm currently running Hadoop 0.20.1 with HBase 0.90.2. I've followed ...

68. hbase thrift api has method like HBaseAdmin.modifyColumn?    stackoverflow.com

is there a method in hbase thrift api that like HBaseAdmin.modifyColumn ? i can't find any method contain "modify" in thrift schema

69. HBase & Mahout - Using HBase as a Datastore/source for Mahout - Classification    stackoverflow.com

I'm working on a large text classification project and we have our text data (simple messages) stored in HBase. We have two problems, first we would like to use HBase as ...

70. HBase filter inheritance consultation    stackoverflow.com

I need a filter which is a bit like TimestampsFilter except that it takes a time frame and applies every row with timestamp within this frame. This is my implementation:

public class TimeFilter ...

71. Hbase Log shows user-level KeeperException messages    stackoverflow.com

I have been getting INFO level log messages as below: 2011-07-31 15:11:02,910 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x1317f82af4e0004 type:create cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/hbase Error:KeeperErrorCode = NodeExists for /hbase 2011-07-31 ...

72. Structured and Unstructured indexing - Lucene and Hbase    stackoverflow.com

I have a set of 200M documents I need to index. Every document has a free text and additional set of sparse metadata information (100+ columns). It seems that the right tool ...

73. hbase data modeling for activity feeds/news feeds/timeline    stackoverflow.com

I decided to use HBase in a project to store the users activities in a social network. Despite the fact that HBase has a simple way to express data (column oriented) ...

74. How can I prevent Hbase from overwriting existing values in cells?    stackoverflow.com

Can anyone explain how to prevent hbase from updating the cell in the concrete column and key if the value already exists?
For example when the two processes in parallel will write ...

75. Is it faster to compare String's, or byte arrays?    stackoverflow.com

So, might sound like an odd question, but is it faster to compare 2 String's, or byte[]'s (using Arrays.equals())? I'm working with Hadoop/Hbase, and I get byte[] as the ...

76. Accessing HBase running in VM with a client on host system    stackoverflow.com

I try to write some data to hbase with a client program HBase @ Hadoop runs in a preconfigured VM from Cloudera @ ubuntu. The Client runs on the system hosting the VM ...

77. Java Connect to HBase(mutiple zookeeprs?)    stackoverflow.com

I am writing a program in Java connecting HBase. I currently have multiple zookeepers in my enviroment. Currently I use:

HBaseConfiguration.create()
config.set("hbase.zookeeper.quorum", "146.169.35.29");
it is working fine. for multiple zookeepers, how do I ...

78. How to cast a java.lang.Class to java.lang.class    stackoverflow.com

See the bottom for the solution. I'm trying to write some generic handling code, but in 1 of the sub-classes, it requires a Class that is more specific. So the base class ...

79. Difference between String.getBytes() and Bytes.toBytes(String data)    stackoverflow.com

I'm writing a Hadoop/HBase job. I needed to transform a Java String into a byte array. Is there any differences between Java's String.getBytes() and Hadoop's Bytes.toBytes()?

80. Hbase Stargate REST Interface: How to encode a scanner with filter in XML?    stackoverflow.com

I'm using Hbase over Stargate and want to use a scanner with certain filters. In java or thrift, this would be no problem, but I don't find any advice how to ...

81. Hbase regionservers    stackoverflow.com

We have installed hadoop cluster. We want to use HBase over it. My hbase-site.xml is below

 <property>
    <name>hbase.rootdir</name>
    <value>hdfs://ali:54310/hbase</value>
    <description>The directory shared ...

82. Is it better to send data to hbase via one stream or via several servers concurrently?    stackoverflow.com

I'm sorry if this question is basic(I'm new to nosql). Basically I have a large mathimatical process that I'm splitting up and having different servers process and send the result ...

83. HBase getting all timestamped values for a cell    stackoverflow.com

i have the following scenario in my hbase instance

hbase(main):002:0> create 'test', 'cf'
0 row(s) in 1.4690 seconds

hbase(main):003:0> put 'test', 'row1', 'cf:a', 'value1'
0 row(s) in 0.1480 seconds

hbase(main):004:0> put 'test', 'row2', 'cf:b', 'value2'
0 row(s) ...

84. Does an HTable increment consider the auto-flush setting?    stackoverflow.com

I'm trying to improve Hbase throughput for increments. Is it possible to "buffer" several increments (for different rows) by setting autoflush to false and then call

85. Get value by family in HBase    stackoverflow.com

Row:

Key, Family:Qualifier, Value
Key, Family1:Qualifier, Value
Key, Family2:Qualifier, Value
Key, FamilyN:Qualifier, Value
In the Java HBase API we can scan a table row by row and then get a FamilyMap for each row. Is there any ...

86. How to delete all data from solr and hbase    stackoverflow.com

how to delete all data from solr by command . We are using solr with lily, means hbase . so can you tell how to delete data from hbase and solr .

87. what is best HBase client API for java    stackoverflow.com

Im working on a project in which i got to use hbase.The project is in java based. I need to know what is the best hbase client api for java.

88. Is there any way while using redis we could write behind to hbase    stackoverflow.com

As far as i know redis only write-behind in a binary file. but our software requirement is to write behind to hbase using any compatible distributed maps(redis).Is there any way while ...

89. Hbase client do not able to connect with remote Hbase server    stackoverflow.com

i have written a following hbase client class for remote server:

System.out.println("Hbase Demo Application ");

            // CONFIGURATION

     ...

90. Uncatchable exception NodeJS    stackoverflow.com

I have an application which writes to a datastore, so I attempt to send an HTTP request out to the datastore (hbase + stargate). ETIMEDOUT exception, which kills the process. I ...

91. Is there a maximum version number in hbase?    stackoverflow.com

If I want to insert in a table:

row | fam:qualifier | timestamp | value
1 | foo:bar | 12345 | 2
1 | foo:bar | 12346 | 3
1 | foo:bar | 12347 | ...

92. Why doesn't sending HBase Gangla metrics work from Java with Aspectj AOP?    stackoverflow.com

I'm trying to do HBase performance monitoring with Aspectj using Hbase metrics and push the results in Ganglia without success. Logging works, so my aspect is executing, but it won't push ...

93. Importtsv not loading all records    stackoverflow.com

I'm calling importtsv from within a Java class and for some reason it's not loading all of the records. Not sure if this is an actual importtsv problem or something ...

94. What is best architecture to store huge videos and lot log file with processed data?    stackoverflow.com

It is a research project. We will record lot videos everyday, and metadata with log data would be saved in semantic model, RDF or OWL. The video would be used to ...

95. what is the volume of Cloudera CDH3 for 50 nodes    stackoverflow.com

The free version only support limited 50 nodes. If I use 10 times 2T hard disk for one computer. That means 10*2*50 = 1000T I could save 1000T data, right? Thanks

96. Why Hbase only return 3 version for a cell no matter I set { VERSION = 100} or not    stackoverflow.com

    v = data.getValues(XP_PHONE);
    for (int i = 0; i < v.length; i++) {
        put.add(COLFAM, COL_PHONE, i, Bytes.toBytes(v[i].trim()));
 ...

97. Architecture issues in web services and image storing ?    stackoverflow.com

Explanation of the scenario : Numerous buyers can register with the Hub(market place).There are numerous suppliers with a personalized application and an independent data storage system(it could be a text file,excel sheet,various ...

98. HBase KeyValue.getKey() returns extra characters    stackoverflow.com

the following hBase code returns some weird characters on the front of my rowKey:

"\u0000""\u0014""ei:shrimp:-749…."
The prepended weird characters are '\u0000' and '\u0014', and sometimes '\u0016'. I put quotes in the ...

99. HBase binding to an incorrect address    stackoverflow.com

I'm attempting to run running HBase in pseudo-distributed mode. I've followed all of the steps in the tutorial. My hbase-site.xml looks like this:

<configuration>
        <property>
 ...

100. Using HBase for analytics    stackoverflow.com

I'm almost completely new to HBase. I would like to take my current site tracking based on MySQL and put it to HBase because MySQL simply doesn't scale anymore. I'm totally lost ...