Handling Chinese /Japense characters in sqoop import


Handling Chinese /Japense characters in sqoop import



I am trying to do sqoop import from db2, where table contains Chinese characters in 2 columns like 燃油油位传感器



Using below sqoop command:


sqoop job -conf /app1/sqoop-metastore/jdcp/sqoop-site.xml --create <jobname>
-- import --connect <connectionstring> --username <xxx> --password-file <xxx>
--table <ttt> --target-dir <targetpath> --fields-terminated-by '07' --map-
column-java DTC_NAME=String,DTC_DESC=String -m 1 --delete-target-dir



Getting below error:



Error: java.io.IOException: SQLException in nextKeyValue
Caused by: com.ibm.db2.jcc.am.SqlException: [jcc][t4][1065][12306][4.15.120] Caught java.io.CharConversionException. See attached Throwable for details. ERRORCODE=-4220, SQLSTATE=null
Caused by: java.nio.charset.MalformedInputException: Input length = 1
at java.nio.charset.CoderResult.throwException(CoderResult.java:281)
at com.ibm.db2.jcc.am.q.a(q.java:45)
at com.ibm.db2.jcc.am.jc.a(jc.java:2862)
... 20 more



Could you please provide some pointers?
Thanks in advance.





What's your target-Db2-database (or table/column/tablespace ) encoding and territory? What's your sqoop session locale ? What Db2-driver version are you using?
– mao
Jul 2 at 14:10





Can you try Sqoop HIve import with --query option use --map-column-hive with Sqoop hive import
– Sandeep Singh
Jul 2 at 14:11



--query


--map-column-hive





Did you try community.hortonworks.com/questions/99600/… or community.hortonworks.com/content/supportkb/198290/…?
– tk421
Jul 2 at 19:34









By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

-

Popular posts from this blog

api-platform.com Unable to generate an IRI for the item of type

api-platform.com Unable to generate an IRI for the item of type I'm trying to setup my first api-platform instance and have run into some presumably noob questions around IDE. What i'm trying to do is setting up an register and reset entity in order to deal with registrations and password reminders from an app. And then have the entity's passed to a custom controller to do some checks, balances and mails afterwards (haven’t gotten around to that yet). But I keep running into this error when posting to my custom entities: { "@context": "/api/contexts/Error", "@type": "hydra:Error", "hydra:title": "An error occurred", "hydra:description": "Unable to generate an IRI for the item of type "AppXXXUserBundleEntityRegister"", "trace": [ { "namespace": "", "short_class": "", "c
Read more

PHP contact form sending but not receiving emails

PHP contact form sending but not receiving emails I have created a contact form using PHP to send the data. The form seems to send fine as there are no errors and success message appears, however I am not receving the emails into the designated inbox. I am using PHPMailer as I originally tried just using the php 'mail' command which I now understand is a bit hit and miss. I cannot see why I would not be receving the emails so I would be very grateful for any help that could be given. I'm quite new to PHP so please be patient with me :) <?php use PHPMailerPHPMailerPHPMailer; use PHPMailerPHPMailerException; $msg = ""; if (isset($_POST['submit'])) { require 'phpmailer/src/Exception.php'; require 'phpmailer/src/PHPMailer.php'; require 'phpmailer/src/SMTP.php'; function sendemail ($to, $from, $body) { $mail = new PHPMailer(true); $mail->setFrom($from); $mail->addAddress($to); $ma
Read more

Do graphics cards have individual ID by which single devices can be distinguished?

Do graphics cards have individual ID by which single devices can be distinguished? I have several graphics cards of the same manufacturer and same model and I want to distinguish them not only by the pcie socket they reside in but by some individual value I can read from the hardware. Is there such value and if so what would it be called and how could I access it? Right now I'm using modern nvidia cards (10xx series) and nvidia inspector.but I'd prefer if there was any value that was also applicable to amd. I have programming and scripting knowledge. I am running Windows 10 1 Answer 1 This is a powershell example to pull information from video cards. The DeviceID is supposed to be unique but only if the manufacturer supports Windows Display Driver Model (WDDM). (I copied this directly from docs.microsoft.com) $strComputer = "." $colItems = get-wmiobject -class "Win32_VideoC
Read more