HIve query stops in between when running MapReduce job
NickName:Gaurav Ask DateTime:2016-07-23T22:45:53

HIve query stops in between when running MapReduce job

I am running a single node cluster on Ubuntu 16.04. Hadoop version is 2.7.2 and Hive 1.2.1.

When I run hive queries which involve map-reduce job like partitioning or bucketing etc. It shows progress for sometime and then process get stop and comes out of command line. All the daemons get stop automatically and even my hadoop user (hduser) closes down and command line comes to default user.

Here is my log when I run query of copying data from one table to other.

hive> insert into table A1 select id,age,symptoms_pertaining_illness,sex from allcities;
Query ID = hduser_20160723195334_b34925b4-d6b7-46f2-a5ef-2e9e6b7c5293
Total jobs = 3
Launching Job 1 out of 3
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_1469283576772_0001, Tracking URL = http://gaurav-HP-Notebook:8088/proxy/application_1469283576772_0001/
Kill Command = /usr/local/hadoop/bin/hadoop job  -kill job_1469283576772_0001
Hadoop job information for Stage-1: number of mappers: 3; number of reducers: 0
2016-07-23 19:53:43,738 Stage-1 map = 0%,  reduce = 0%
2016-07-23 19:53:58,136 Stage-1 map = 33%,  reduce = 0%, Cumulative CPU 18.15 sec
killing job with: job_1469283576772_0001
gaurav@gaurav-HP-Notebook:~$

I tried setting up no. of mappers and reducers but it didn't work. The problem is coming with smaller as well as larger datasets.

Copyright Notice:Content Author:「Gaurav」,Reproduced under the CC 4.0 BY-SA copyright license with a link to the original source and this disclaimer.
Link to original article:https://stackoverflow.com/questions/38543011/hive-query-stops-in-between-when-running-mapreduce-job

More about “HIve query stops in between when running MapReduce job” related questions

HIve query stops in between when running MapReduce job

I am running a single node cluster on Ubuntu 16.04. Hadoop version is 2.7.2 and Hive 1.2.1. When I run hive queries which involve map-reduce job like partitioning or bucketing etc. It shows progre...

Show Detail

Mapreduce job not launching when running hive query with where clause

I am using apache-hive-1.2.2 on Hadoop 2.6.0. When am running a hive query with where clause it is giving results immediately without launching any MapReduce job. I'm not sure what is happening. Ta...

Show Detail

How to set mapreduce job name for hive query child jobs?

our hive query creates 9 map-reduce jobs and 17 stages(when I ran EXPLAIN command, output showed 17 STAGES and STAGE DEPENDENCIES). Every child job has the same mapreduce.job.name To distinguish ...

Show Detail

error while running hive mapreduce job

when I trying to run hive commands which involve mapreduce, I am getting the following error, please help me solve this: hive (hiveclass)> create table companies2 as select * from companies; WA...

Show Detail

When will Hive run the MapReduce?

As I have observed some times the Hive is giving the result immediately but some times it is running the MapReduce job. Just wanted to know when it will run the MapReduce job and when it will not run?

Show Detail

Give MapReduce parameters to hive query

Is there any way to give map reduce parameters to hive query? e.g. I am doing this, and it does not set that parameter in MR job. hive (default)> set mapreduce.map.output.value.class=org.apache...

Show Detail

ResourceManager webpage UI not showing Hive mapreduce job

Hive version: 3.1.3, Hadoop version: 3.3.4 I'm new to Hive and Hadoop environment. Followed these links for Hadoop and Hive installations. Was trying out Hive insertion using the example shown here:

Show Detail

ResourceManager webpage UI not showing Hive mapreduce job

Hive version: 3.1.3, Hadoop version: 3.3.4 I'm new to Hive and Hadoop environment. Followed these links for Hadoop and Hive installations. Was trying out Hive insertion using the example shown here:

Show Detail

How to find the reason for hive mapreduce job that killed automatically

I have executed hive query and it got killed automatically (not manually by anyone) I am not able to find the reason in any of the logs. Cloudera version : 5.4.11 Hive : 1.1.0 I see the similar

Show Detail

Hive query does not begin MapReduce process after starting job and generating Tracking URL

I'm using Apache Hive. I created a table in Hive (similar to external table) and loaded data into the same using the LOAD DATA LOCAL INPATH './Desktop/loc1/kv1.csv' OVERWRITE INTO TABLE adih; comma...

Show Detail