hive - Filtering null values in Scala -


i have hive table has null , empty values in columns. null values representation in table \n. trying select rows column not null in scala. have tried using

a. if (a.equals("\\n"))

b. if (!option(a).getorelse("").isempty)

c. using length(trim(a))

none of these options worked code either filter not work or rows excluded.

does has suggestions?

according https://cwiki.apache.org/confluence/display/hive/languagemanual+transform, hive's \n string, "\n", in java , hence in scala that's represented "\n" can matched using {scala.predef.string = java.lang.string}.matches("\\n") in following test:

val s = "\\n" println(s.matches("\\\\n")) // prints true

if not work please provide information how accessing hive table , hive version can attempt replicate error.


-

Comments

Post a Comment

Popular posts from this blog

Java 8 + Maven Javadoc plugin: Error fetching URL -

i attempting generate javadoc links javadoc dependencies. have tried various means generate javadoc not produce qualified class names references classes dependencies. wanted links java doc simplified class names. however, java api classnames, no links , have qualified class names. working java 8. have following configuration: <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-javadoc-plugin</artifactid> <version>2.10.2</version> <configuration> <reportoutputdirectory>${project.basedir}/target</reportoutputdirectory> <destdir>javadoc</destdir> <windowtitle>epiphany</windowtitle> <doctitle>epiphany</doctitle> <show>private</show> <detectlinks>false</detectlinks> <detectoffline...
Read more

android - How to delete or change the searchview icon inside the SearchView actionBar? -

Image
how remove or change search view icon inside edittext? using appcompat library. i used below code modify , remove it's not working: searchmanager searchmanager = (searchmanager) getsystemservice(context.search_service); searchview.setsearchableinfo(searchmanager.getsearchableinfo(getcomponentname())); view search_mag_icon = (view)searchview.findviewbyid(android.support.v7.appcompat.r.id.search_mag_icon); search_mag_icon.setbackgroundresource(r.drawable.ic_stub); //search_mag_icon.setvisibility(view.gone); finally found solution. try following: try { field mdrawable = searchview.class.getdeclaredfield("msearchhinticon"); mdrawable.setaccessible(true); drawable drawable = (drawable)mdrawable.get(your search view here); drawable.setalpha(0); } catch (exception e) { e.printstacktrace(); }
Read more

c++ - Msgpack packing bools bug -

for c++ project use c++ msgpack library available in ubuntu (14.04) standard repository under name libmsgpack-dev. all works fine except when try pack bools. there things go absolutely bananas. first wrote simple test study pack method. turned out, can not trusted packing bools. here simple test showing problem: #include <msgpack.hpp> test_case("bool packing", "[msgpack1]") { msgpack::sbuffer buf; msgpack::packer<msgpack::sbuffer> p(&buf); std::string key = "boolvalue"; bool value = true; p.pack_map(1); { p.pack(key); p.pack(value); } msgpack::unpacked msg; msgpack::unpack(&msg, buf.data(), buf.size()); std::map<std::string, msgpack::object> m; msg.get().convert(&m); bool loaded_value; m.at(key).convert(&loaded_value); info("we packed: " << value); info("we loaded: " << loaded_value); r...
Read more