Resolve “Slow BlockReceiver write packet to mirror”
“Slow BlockReceiver write packet to mirror” error usually indicates an unhealthy node in your Hadoop cluster or if the Node…
Hadoop
To Learn about Hadoop and its components
How to find and delete files older than X days in HDFS
find and delete files older than X days in HDFS
How to get the specific column from the command output in Linux
The awk command is used in Linux to get the value of the specific column from a command output or…
Solr TTL – Auto-Purging Solr Documents
In this blog, We will learn about Auto-Purging and the importance of TTL (Time-To-Live), and how to remove documents automatically…
How to Recover Standby Namenode (Bootstrap Standby Namenode)
– There are scenarios, Where we can’t able to bring back the standby Name node due to Disk crash, OS…
Kafka CLI Command Cheat Sheet
This article, Helps you to know the Kafka CLI Command used to create and list of topics and to start…
Resolve “Orphan region in HDFS: Unable to load .regioninfo from table” in Hbase
“Orphan region in HDFS: Unable to load .regioninfo from table” usually happens, When “.regioninfo” is unavailable under the HDFS table…
How to increase CPU Utilization in Linux (CPU Spike)
There are scenarios, Where we need to test or replicate an issue in the cluster, which requires a CPU spike…
Deleting Documents in Apache Solr manually
Multiple times, we need to remove the collection data manually, Like when it occupies a lot of space in the…
What is meant by “Tablet server is quiescing” in Apache Kudu
“Tablet server is quiescing” in a state When the Kudu Tablet server is down or not responding and the Kudu…
Resolve the “Memory limit exceeded” issue in IMPALA
“Memory limit exceeded” usually, happens When the query reached its max limit and is unable to allocate any more memory
Resolve “TTransportException: MaxMessageSize reached” Hive
Symptoms The “TTransportException: MaxMessageSize reached” exception will cause hive query failures when it tries to access a table that has…
Resolve “MetaException(message:Timeout when executing method: get_partitions” ERROR in Hive
“MetaException(message:Timeout when executing method: get_partitions” Occurs, When your query is unable to get the meta information
How to Recover HDFS Journal Node
What is Journal Node? – Journal nodes are the ones that help to store the recent edits in the HDFS…
Resolve Region “not on HDFS or in hbase:meta but deployed on” issue in Hbase
Region “not on HDFS or in hbase:meta but deployed on” Error indicate that you have a stale reference in the regions server memory
Apache Hbase: API Client fails with “No common protection layer between client and server”
Symptom: When a client tries to connect to the Hbase server and fails with the below exception INFO org.apache.hadoop.hbase.client.RpcRetryingCallerImpl -…
How to collect Clusterstate.json file (Apache Solr)
What is Clusterstate.json The Clusterstate.json file consists of information about the collection, shard, and replica like where it is hosted…
Resolve the “Master startup cannot progress” issue in Hbase
Symptom: During Hbase service Startup/Restart, The Hbase master fails to initialize, Running any Hbase-related command would give the below error…
Resolve “org.apache.hadoop.hbase.replication.regionserver.ReplicationSink: Unable to accept edit”
Why we are seeing this ERROR: The ERROR means your Regions server is unable to accept any more edits from…
How to Create Skewed Table with Apache Hive
– Use this for testing purposes and to experiment on data skew – We are creating 2 tables one with…
Resolve “hole in the region chain” issue in Hbase
In Hbase, Table data are split into multiple regions and managed by region servers. The region consists of rows between…
Resolve “STUCK Region-In-Transition” in Apache Hbase
What is called a “Region-In-Transition” state? It is a state, where the region is marked as transitioning and will not…
Resolve “org.apache.hadoop.hbase.TableInfoMissingException: No table descriptor file under” in Hbase
“org.apache.hadoop.hbase.TableInfoMissingException: No table descriptor file under” usually happens if the table descriptor file went missing (which is called an Orphan…
Resolve Region “found in META, but not in HDFS” issue in Hbase
When you are seeing the below ERROR messages in the logs then most probably there is a stale reference in…
How to stop an application in bash after a certain amount of time
Using a “timeout” command to stop an application or a command after a certain time limit is the best and…
Resolve “org.apache.hadoop.hbase.NotServingRegionException” in Apache Hbase
Symptom: The application fails while accessing the regions that are offline org.apache.hadoop.hbase.NotServingRegionException: org.apache.hadoop.hbase.NotServingRegionException: test:test,4:sample.703243:201310,1632342333102.3067sdfs84js51dd3e374aa1bfa2bea. is not online on <hostname>,16020,1632342333102 Cause:…
Resolve “Cannot modify at runtime. It is not in list of params that are allowed to be modified at runtime” in Hive
“Cannot modify at runtime. It is not in the list of params that are allowed to be modified at runtime”…
Resolve “application/x-www-form-urlencoded content length (X bytes) exceeds upload limit of 2048 KB” issue in Solr
“application/x-www-form-urlencoded content length (X bytes) exceeds upload limit of 2048 KB” error occurs when “formdataUploadLimit” reaches its max limit. This…
How to Add or Delete Replicas in Solr Collection
In this article, We will understand about Solr Search and How to add or delete a replica in the Solr…
Resolve “org.apache.hadoop.hive.ql.lockmgr.LockException(No record of transaction could be found)”
Symptom: Hive/Tez job fails with the below error messages Error while compiling statement: FAILED: Hive Internal Error: org.apache.hadoop.hive.ql.lockmgr.LockException(No record of…
IPC’s epoch X is less than the last promised epoch Y”
“IPC’s epoch X is less than the last promised epoch Y” will see this error message in both Namenode and…
Apache Ozone vs HDFS
Apache Ozone vs HDFS
How to Create a Hive table with Ozone Filesystem
Apache Hadoop Ozone is a distributed object store for Hadoop designed for scaling to trillions of objects and providing a…
How to Connect to Apache Phoenix Shell from Terminal
Apache Phoenix allows you to run SQL queries on top of HBase tables. We can use JDBC or SQLLINE command line utility to access phoenix
How to connect impala using Beeline (Direct and via Apache Knox)
There are multiple ways you can connect with Impala. In this post, We are going to discuss connecting Impala using…
Use of “distrib=false” in Apache Solr
Apache Solr is a widely used search platform that allows users to store, index, and search large volumes of data…