Hue: Job Designer

1. hue [jobsub] saving a design shows an empty page after.

when I check the system log whic likes followings:

The main error is :

WebHdfsException: SecurityException: Failed to obtain user group information:
org.apache.hadoop.security.authorize.AuthorizationException: User:
 hue is not allowed to impersonate hue (error 401)

A: change hadoop core-site.xml and the following properties to it and upgrade to all nodes, restart cluster

<property>
  <name>hadoop.proxyuser.hue.hosts</name>
  <value>*</value>
</property>
<property>
  <name>hadoop.proxyuser.hue.groups</name>
  <value>*</value>
</property>

2. When I design a sqoop job in "Job Designer" and save , but the list only displays the example jobs.

My designed job is missing. Check the logs, find some errors

A: change permissions by command

hdfs dfs -chmod -R 777 ./

3. when I submit a sqoop job from Job Designer to run, an error produces

To check the configuration

A: change hue.ini to

[[hdfs_clusters]]
    # HA support by using HttpFs

    [[[default]]]
      # Enter the filesystem uri
      fs_defaultfs=hdfs://192.168.122.1:2014

      # NameNode logical name.
      #logical_name=zhj-c0
      logical_name=hdfs://192.168.122.1:2014

      # Use WebHdfs/HttpFs as the communication mechanism.
      # Domain should be the NameNode or HttpFs host.
      # Default port is 14000 for HttpFs.
      webhdfs_url=http://192.168.122.1:50070/webhdfs/v1

      # Change this if your HDFS cluster is Kerberos-secured
      ## security_enabled=false

 [[yarn_clusters]]

    [[[default]]]
      # Enter the host on which you are running the ResourceManager
      resourcemanager_host=192.168.122.1

      # The port where the ResourceManager IPC listens on
      resourcemanager_port=2015

      # Whether to submit jobs to this cluster
      submit_to=True

      # Change this if your YARN cluster is Kerberos-secured
      ## security_enabled=false

      # URL of the ResourceManager API
      resourcemanager_api_url=http://192.168.122.1:2019

      # URL of the ProxyServer API
      ## proxy_api_url=http://localhost:8088

      # URL of the HistoryServer API
      history_server_api_url=http://192.168.122.1:19888

      # NameNode logical name.
      #logical_name=zhj-c0
      logical_name=hdfs://192.168.122.1:2014
This cofiguration is werid due to its name, actually it means nameNode

The values in the above configureation are corrosponding to hadoop related configurations listed in the

following table

https://groups.google.com/a/cloudera.org/forum/#!topic/hue-dev/QNOb5RWwYNQ

References

https://github.com/cloudera/hue/blob/master/docs/user-guide/jobdesigner.md

http://cloudera.github.io/hue/docs-3.5.0/release-notes/release-notes-3.5.0.html

http://grokbase.com/p/cloudera/hue-dev/13c5mehwrq/review-request-jobsub-saving-a-design-shows-an-empty-page-after

https://review.cloudera.org//r/3895/diff/

猜你喜欢