Handling Chinese /Japense characters in sqoop import


Handling Chinese /Japense characters in sqoop import



I am trying to do sqoop import from db2, where table contains Chinese characters in 2 columns like 燃油油位传感器



Using below sqoop command:


sqoop job -conf /app1/sqoop-metastore/jdcp/sqoop-site.xml --create <jobname>
-- import --connect <connectionstring> --username <xxx> --password-file <xxx>
--table <ttt> --target-dir <targetpath> --fields-terminated-by '07' --map-
column-java DTC_NAME=String,DTC_DESC=String -m 1 --delete-target-dir



Getting below error:



Error: java.io.IOException: SQLException in nextKeyValue
Caused by: com.ibm.db2.jcc.am.SqlException: [jcc][t4][1065][12306][4.15.120] Caught java.io.CharConversionException. See attached Throwable for details. ERRORCODE=-4220, SQLSTATE=null
Caused by: java.nio.charset.MalformedInputException: Input length = 1
at java.nio.charset.CoderResult.throwException(CoderResult.java:281)
at com.ibm.db2.jcc.am.q.a(q.java:45)
at com.ibm.db2.jcc.am.jc.a(jc.java:2862)
... 20 more



Could you please provide some pointers?
Thanks in advance.





What's your target-Db2-database (or table/column/tablespace ) encoding and territory? What's your sqoop session locale ? What Db2-driver version are you using?
– mao
Jul 2 at 14:10





Can you try Sqoop HIve import with --query option use --map-column-hive with Sqoop hive import
– Sandeep Singh
Jul 2 at 14:11



--query


--map-column-hive





Did you try community.hortonworks.com/questions/99600/… or community.hortonworks.com/content/supportkb/198290/…?
– tk421
Jul 2 at 19:34









By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

-

Popular posts from this blog

api-platform.com Unable to generate an IRI for the item of type

api-platform.com Unable to generate an IRI for the item of type I'm trying to setup my first api-platform instance and have run into some presumably noob questions around IDE. What i'm trying to do is setting up an register and reset entity in order to deal with registrations and password reminders from an app. And then have the entity's passed to a custom controller to do some checks, balances and mails afterwards (haven’t gotten around to that yet). But I keep running into this error when posting to my custom entities: { "@context": "/api/contexts/Error", "@type": "hydra:Error", "hydra:title": "An error occurred", "hydra:description": "Unable to generate an IRI for the item of type "AppXXXUserBundleEntityRegister"", "trace": [ { "namespace": "", "short_class": "", "c
Read more

How to set up datasource with Spring for HikariCP?

How to set up datasource with Spring for HikariCP? Hi I'm trying to use HikariCP with Spring for connection pool. I'm using jdbcTempLate and JdbcdaoSupport. This is my spring configuration file for datasource: <bean id="dataSource" class="com.zaxxer.hikari.HikariDataSource"> <property name="dataSourceClassName" value="oracle.jdbc.driver.OracleDriver"/> <property name="dataSource.url" value="jdbc:oracle:thin:@localhost:1521:XE"/> <property name="dataSource.user" value="username"/> <property name="dataSource.password" value="password"/> </bean> But unfortunately the following error message is generating: Cannot resolve reference to bean 'dataSource' while setting bean property 'dataSource'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'dataSource'
Read more

Display dokan vendor name on Woocommerce single product pages

Display dokan vendor name on Woocommerce single product pages With woocommerce I am using Dokan plugin and I am trying to display the vendor name, rating and vendor location on single product pages. I tried this code to display vendor name but no luck: //show store name add_action( 'woocommerce_single_product_summary', 'show_store_name', 20 ); function show_store_name() { printf( '<b>Seller Name:</b> <a href="%s">%s</a>', dokan_get_store_url( $author->ID ), $store_info['store_name'] ); } Any help is appreciated. 1 Answer 1 I don't use dokan plugin. Here is the way to get the (post) author ID and to make your code work: add_action( 'woocommerce_single_product_summary', 'display_author_name', 20 ); function display_author_name() { // Get the author ID (the vendor ID) $vendor_id = get_post_field( &#
Read more