{"id":14861,"date":"2013-07-30T21:00:12","date_gmt":"2013-07-30T12:00:12","guid":{"rendered":"http:\/\/www.sssg.org\/blogs\/hiro345\/?p=14861"},"modified":"2013-09-09T11:33:54","modified_gmt":"2013-09-09T02:33:54","slug":"windows%e3%81%aetsv%e3%83%95%e3%82%a1%e3%82%a4%e3%83%ab%e3%81%8b%e3%82%89linux%e3%82%92%e4%bd%bf%e3%81%a3%e3%81%a6sql%e6%96%87%e3%82%92%e7%94%9f%e6%88%90%e3%81%99%e3%82%8b%e3%81%ab%e3%81%af","status":"publish","type":"post","link":"https:\/\/www.hiro345.net\/blogs\/hiro345\/archives\/14861.html","title":{"rendered":"Windows\u306eTSV\u30d5\u30a1\u30a4\u30eb\u304b\u3089Linux\u3092\u4f7f\u3063\u3066SQL\u6587\u3092\u751f\u6210\u3059\u308b\u306b\u306f"},"content":{"rendered":"<p>Windows\u306eTSV\u30d5\u30a1\u30a4\u30eb\u304b\u3089Linux\u3092\u4f7f\u3063\u3066SQL\u6587\u3092\u751f\u6210\u3057\u305f\u304f\u306a\u308b\u3068\u304d\u304c\u3042\u308a\u307e\u3059\u3002load data\u3068\u304b\u4f7f\u3063\u3066\u3082\u3044\u3044\u306e\u3067\u3059\u304c\u3001\u3084\u306f\u308a\u4e2d\u9593\u8868\u73fe\u3068\u3057\u3066SQL\u306b\u843d\u3068\u305b\u308b\u3068\u5b89\u5fc3\u3057\u307e\u305b\u3093\u304b\u3002\u3082\u3061\u308d\u3093\u3001\u9593\u306b\u3044\u308d\u3044\u308d\u306a\u5909\u63db\u51e6\u7406\u3092\u304b\u307e\u305b\u305f\u3044\u3068\u304d\u3082\u3042\u308a\u307e\u3059\u3057\u306d\u3002<br \/>\n<!--more--><br \/>\ntable.tsv\u306fExcel\u306a\u3069\u304b\u3089\u30d5\u30a1\u30a4\u30eb\u4fdd\u5b58\u3067\u30c6\u30ad\u30b9\u30c8\u5f62\u5f0f\u3067\u4fdd\u5b58\u3057\u305f\u3082\u306e\u3092\u60f3\u5b9a\u3057\u3066\u3044\u307e\u3059\u3002\u305f\u3068\u3048\u3070\u4e0b\u8a18\u3002\u3053\u308c\u3092table.tsv\u3068\u3057\u307e\u3059\u3002<\/p>\n<pre class=\"brush: bash; gutter: true\">\r\n2\tabc2\r\n1\tabc1\r\n3\tabc3\r\n<\/pre>\n<p>\u6b21\u306ebash\u30b9\u30af\u30ea\u30d7\u30c8\u3067\u3001\u3053\u306e\u30d5\u30a1\u30a4\u30eb\u3092\u8aad\u307f\u8fbc\u3093\u3067\u3001\u6587\u5b57\u30b3\u30fc\u30c9\u3092iconv\u3067\u5909\u63db\u3057\u3066\u3001tr\u3067\u6539\u884c\u30b3\u30fc\u30c9\u306e\u8abf\u6574\u3092\u3057\u3066\u3001sort\u3067\u4e26\u3073\u66ff\u3048\u3001uniq\u3067\u91cd\u8907\u6392\u9664\u3092\u3057\u3066\u3044\u307e\u3059\u3002\u6700\u5f8c\u306bawk\u3067SQL\u6587\u751f\u6210\u3092\u3057\u3066update.sql\u3068\u3044\u3046\u30d5\u30a1\u30a4\u30eb\u3078\u4fdd\u5b58\u3067\u304d\u307e\u3059\u3002createsql.sh\u3068\u3044\u3046\u540d\u524d\u3067\u7528\u610f\u3057\u305f\u3068\u3057\u307e\u3059\u3002<\/p>\n<pre class=\"brush: bash; gutter: true\">\r\n#!\/bin\/sh\r\n$f=&quot;table.tsv&quot;\r\nif [ -e ${f} ]; then\r\n  iconv -f Windows-31J -t UTF-8 ${f} | \\\r\n    tr -d &#039;\\r&#039;| tr -d &#039;^\\t&#039; | sort | uniq | \\\r\n    awk -f createsql.awk - &gt; update.sql\r\nfi\r\n<\/pre>\n<p>createsql.awk \u306f\u6b21\u306e\u3088\u3046\u306b\u3057\u307e\u3059\u3002createsql.sh\u3068\u540c\u3058\u30c7\u30a3\u30ec\u30af\u30c8\u30ea\u306b\u7f6e\u304d\u307e\u3059\u3002sample_table\u306esample_code\u304c\u3042\u308b\u5024\u3068\u306a\u308bsample_col1\u306e\u30ab\u30e9\u30e0\u5024\u3092\u66f4\u65b0\u3059\u308bSQL\u3092\u751f\u6210\u3057\u3066\u3044\u307e\u3059\u3002\u30b7\u30f3\u30b0\u30eb\u30af\u30a9\u30fc\u30c8\u3092\u542b\u3080\u6587\u5b57\u5217\u3092\u751f\u6210\u3059\u308b\u65b9\u6cd5\u304c\u7d50\u69cb\u9762\u5012\u306a\u306e\u3067\u30d7\u30ed\u30b0\u30e9\u30e0\u306f\u30d5\u30a1\u30a4\u30eb\u306b\u66f8\u3044\u3066\u3042\u308a\u307e\u3059\u3002<\/p>\n<pre class=\"brush: bash; gutter: true\">\r\n{ printf(&quot;UPDATE sample_table SET sample_col1=&#039;%s&#039; where sample_code=&#039;%s&#039;;\\n&quot;, $2, $1); }\r\n<\/pre>\n<p>\u5b9f\u884c\u306f\u6b21\u306e\u3088\u3046\u306b\u3057\u307e\u3059\u3002<\/p>\n<pre class=\"brush: bash; gutter: true\">\r\n$ .\/createsql.sh\r\n<\/pre>\n<p>sed\u3001awk\u3001bash\u306b\u3064\u3044\u3066\u306f\u4e0b\u8a18\u304c\u53c2\u8003\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n<ul>\n<li><a type=\"amzn\" asin=\"4797321946\">\u5165\u9580UNIX\u30b7\u30a7\u30eb\u30d7\u30ed\u30b0\u30e9\u30df\u30f3\u30b0\u2015\u30b7\u30a7\u30eb\u306e\u57fa\u790e\u304b\u3089\u5b66\u3076UNIX\u306e\u4e16\u754c <\/a><\/li>\n<li><a type=\"amzn\" asin=\"4900900583\">sed &#038; awk\u30d7\u30ed\u30b0\u30e9\u30df\u30f3\u30b0 \u6539\u8a02\u7248 (A nutshell handbook) <\/a><\/li>\n<\/ul>\n<div>\n<iframe loading=\"lazy\" style=\"width: 120px; height: 240px;\" src=\"\/\/rcm-jp.amazon.co.jp\/e\/cm?t=hiro345-22&amp;o=9&amp;p=8&amp;l=as1&amp;asins=4797321946&amp;ref=tf_til&amp;fc1=000000&amp;IS2=1&amp;lt1=_blank&amp;m=amazon&amp;lc1=0000FF&amp;bc1=000000&amp;bg1=FFFFFF&amp;f=ifr\" height=\"240\" width=\"320\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\"><\/iframe><iframe loading=\"lazy\" style=\"width: 120px; height: 240px;\" src=\"\/\/rcm-jp.amazon.co.jp\/e\/cm?t=hiro345-22&amp;o=9&amp;p=8&amp;l=as1&amp;asins=4900900583&amp;ref=tf_til&amp;fc1=000000&amp;IS2=1&amp;lt1=_blank&amp;m=amazon&amp;lc1=0000FF&amp;bc1=000000&amp;bg1=FFFFFF&amp;f=ifr\" height=\"240\" width=\"320\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\"><\/iframe>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Windows\u306eTSV\u30d5\u30a1\u30a4\u30eb\u304b\u3089Linux\u3092\u4f7f\u3063\u3066SQL\u6587\u3092\u751f\u6210\u3057\u305f\u304f\u306a\u308b\u3068\u304d\u304c\u3042\u308a\u307e\u3059\u3002load data\u3068\u304b\u4f7f\u3063\u3066\u3082\u3044\u3044\u306e\u3067\u3059\u304c\u3001\u3084\u306f\u308a\u4e2d\u9593\u8868\u73fe\u3068\u3057\u3066SQL\u306b\u843d\u3068\u305b\u308b\u3068\u5b89\u5fc3\u3057\u307e\u305b\u3093\u304b\u3002\u3082\u3061\u308d\u3093\u3001\u9593\u306b\u3044\u308d\u3044\u308d\u306a\u5909\u63db\u51e6 &hellip; <a href=\"https:\/\/www.hiro345.net\/blogs\/hiro345\/archives\/14861.html\">\u7d9a\u304d\u3092\u8aad\u3080 <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[15],"tags":[293,56,383,1209,440],"class_list":["post-14861","post","type-post","status-publish","format-standard","hentry","category-program","tag-awk","tag-bash","tag-iconv","tag-linux","tag-sed"],"_links":{"self":[{"href":"https:\/\/www.hiro345.net\/blogs\/hiro345\/wp-json\/wp\/v2\/posts\/14861","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.hiro345.net\/blogs\/hiro345\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.hiro345.net\/blogs\/hiro345\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.hiro345.net\/blogs\/hiro345\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.hiro345.net\/blogs\/hiro345\/wp-json\/wp\/v2\/comments?post=14861"}],"version-history":[{"count":1,"href":"https:\/\/www.hiro345.net\/blogs\/hiro345\/wp-json\/wp\/v2\/posts\/14861\/revisions"}],"predecessor-version":[{"id":14862,"href":"https:\/\/www.hiro345.net\/blogs\/hiro345\/wp-json\/wp\/v2\/posts\/14861\/revisions\/14862"}],"wp:attachment":[{"href":"https:\/\/www.hiro345.net\/blogs\/hiro345\/wp-json\/wp\/v2\/media?parent=14861"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.hiro345.net\/blogs\/hiro345\/wp-json\/wp\/v2\/categories?post=14861"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.hiro345.net\/blogs\/hiro345\/wp-json\/wp\/v2\/tags?post=14861"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}