aboutsummaryrefslogtreecommitdiffstats
path: root/enc
Commit message (Collapse)AuthorAgeFilesLines
...
* enc/encinit.c.erb: use %-linesnobu2012-05-171-8/+7
| | | | | | | * enc/encinit.c.erb: use %-lines to adjust indent in the generated file. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@35670 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* Supports static linking of extensions and encodings again.yugui2012-05-1622-74/+142
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Fixes --with-static-linked-ext. Patch by Google Inc. [ruby-core:45073]. * Makefile.in (ENCOBJS, EXTOBJS): New variables to specify static linked libraries. Also reintroduces extinit.o, introduces encinit.o introduces encinit.o * common.mk: Builds static libraries rather than shared objects if specified. * configure.in (LD): new substitution. Avoids PIE if s * enc/depend: Supports static linked libraries (libencs, libenc, libtrans): New target. * enc/encinit.c.erb: new template to generate the initialization of statically linked encodings. * enc/make_encmake.rb (--module): new flag to specify whether static or dynamic. * transcode_data.h (TRANS_INIT): New macro to get rid of the name collision of encoding initializers and transcoder initializers. * ext/extmk.rb: Fixes the behavior on $extstatic is true. * lib/mkmf.rb (clean-static): new target to clean up static linked libraries. * ruby.c (process_options): New initializes statically linked encodings here. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@35662 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/euc_jp.c: added EUC-JP-2004 and its alias EUC-JISX0213.usa2012-04-2410-0/+8983
| | | | | | | | | | | | | | | | | | | | [ruby-dev:45571] [Feature #6349] Requested by Kyouhei Yanagita <yanagi@shakenbu.org>. * enc/trans/japanese_euc.trans: ditto. * enc/trans/JIS/JISX0213-[12]%UCS@{BMP,SIP}.src: JIS X 0213:2004 -> Unicode mapping table from NetBSD. * enc/trans/JIS/UCS@{BMP,SIP}%JISX0213-[12].src: Unicode -> JIX X 0213:2004 mapping table from NetBSD. * tool/transcode-tblgen.rb: added SIP support. * test/ruby/test_transcode.rb: tests of above changes. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@35460 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/unicode/name2ctype.h, tool/transcode-tblgen.rb: revertnobu2012-04-061-5205/+10065
| | | | | | unlogged changes which committed by accident probably. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@35247 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* struct.c (documentation for rb_struct_members_m):duerst2012-04-061-10065/+5205
| | | | | | | fix 'array of strings' to 'array of symbols' [ruby-core:44152][Bug #6264] git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@35244 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * regparse.c (is_onechar_cclass): optimize character classnaruse2012-02-292-4/+12
| | | | | | | | | | | | Merge Onigmo 27278c12e6674043cc8affca6507e20e119a86ee. * regparse.c (is_onechar_cclass): [bug] unexpected match occurs when a char class contains no char * enc/unicode.c (init_case_fold_table): define the sizes of case folding tables in casefold.h git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@34860 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* suppress warnings.naruse2012-02-251-4/+4
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@34802 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* revert a file which is committed wrong.nari2012-02-211-5205/+10065
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@34720 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * gc.c : remove gc_clear_mark_on_sweep_slots() and usenari2012-02-211-10065/+5205
| | | | | | | | rest_sweep() instead of it, because some dead objects might be marked in next the mark phase by false pointers. [ruby-core:42672] git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@34719 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/depend: ignore mktable.c because it's not encoding library.usa2012-02-201-1/+1
| | | | | | | [ruby-core:42760] [Bug #6049] git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@34708 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/mktable.c (ENC_INFO): constify to suppress warnings.nobu2012-02-191-1/+1
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@34692 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * Merge Onigmo-5.13.1. [ruby-dev:45057] [Feature #5820]naruse2012-02-1739-7272/+14152
| | | | | | | | | | https://github.com/k-takata/Onigmo cp reg{comp,enc,error,exec,parse,syntax}.c reg{enc,int,parse}.h cp oniguruma.h cp tool/enc-unicode.rb cp -r enc/ git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@34663 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* Add more description about Shift_JIS and CP50220.naruse2012-02-152-1/+10
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@34623 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * numeric.c (rb_enc_uint_char): raise RangeError when added codepointnaruse2012-01-082-5/+6
| | | | | | | | | | | | | | | | | is invalid. [Feature #5855] [Bug #5863] [Bug #5864] * string.c (rb_str_concat): ditto. * string.c (rb_str_concat): set encoding as ASCII-8BIT when the string is US-ASCII and the argument is an integer greater than 127. * regenc.c (onigenc_mb2_code_to_mbclen): rearrange error code. * enc/euc_jp.c (code_to_mbclen): ditto. * enc/shift_jis.c (code_to_mbclen): ditto. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@34236 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/iso-8859-16-tbl.rb: add ISO-8859-16 converter.naruse2011-12-092-0/+99
| | | | | | * enc/trans/single_byte.trans: ditto. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@33993 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/unicode.c (PROPERTY_NAME_MAX_SIZE): +1.naruse2011-11-201-1/+1
| | | | | | reported by Ken Takata. [ruby-dev:44894][Bug #5652] git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@33797 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * Makefile.in (enc/unicode/name2ctype.h): remove duplicatednobu2011-11-192-8/+0
| | | | | | ifdefs. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@33793 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* Forward-ports r32780 from branches/ruby_1_9_3 to trunk.yugui2011-07-311-1/+3
| | | | | | | | | -- * enc/Makefile.in (ECHO1): Same as the recent fix in common.mk. ":" in a make variable replacement cause a syntax error with /usr/ccs/bin/make on Solaris. Uses $(NULLCMD) instead. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@32787 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/depend: show srcdir.nobu2011-06-161-1/+1
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@32112 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/ibm737-tbl.rb: greek code page. fixes #4738nobu2011-05-192-0/+131
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@31644 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * remove trailing spaces.nobu2011-05-1511-39/+39
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@31573 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/emoji_iso2022_kddi.trans: ISO-2022-JP-KDDI doesn't havenaruse2011-04-271-2/+0
| | | | | | | | CP932 UDA. Another reason is emacs-mule: the implementation of stateless-iso-2022-jp doesn't support beyond 94x94 (0x7fxx); but CP932 UDA is in 7Fxx-92xx. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@31366 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/utf_16le.c: surpress warning: shorten-64-to-32.naruse2011-03-211-1/+1
| | | | | | | | | | * ext/dbm/dbm.c: ditto. * ext/gdbm/gdbm.c: ditto. * parse.y (Init_ripper): surpress warning: unused value. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@31141 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/shift_jis.c: Change SJIS as an alias of Windows-31J.naruse2011-03-091-1/+17
| | | | | | * enc/shift_jis.c: Add PCK as an alias of Windows-31J. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@31073 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/utf8_mac.trans: parenthesize macro arguments.akr2011-02-041-1/+1
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@30780 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/shift_jis.c (code_to_mbc): cast as int from the subtraction of pointers.naruse2011-02-034-4/+5
| | | | | | | | | | * enc/utf_16le.c (utf16le_mbc_enc_len): use ptrdiff_t. * enc/utf_32be.c (utf32be_left_adjust_char_head): ditto. * enc/utf_32le.c (utf32le_left_adjust_char_head): ditto. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@30771 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/encdb.c: parenthesize macro arguments.akr2011-02-011-3/+3
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@30755 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/emacs_mule.c (emacsmule_islead): 7bit range is also leadingnobu2011-01-301-1/+1
| | | | | | byte. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@30731 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/emacs_mule.c (emacsmule_islead): fix inverse condition.nobu2011-01-301-1/+1
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@30727 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/{emacs_mule,euc_jp}.c (code_to_mbc): suppress warnings.nobu2011-01-054-6/+10
| | | | | | | * enc/iso_8859_{1,2}.c (apply_all_case_fold): ditto. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@30468 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/depend (clean): remove name2ctype.h when out-of-place build.nobu2010-12-291-0/+5
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@30421 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * win32/Makefile.sub (clean-enc): pass V to inferior make.nobu2010-12-292-16/+16
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@30420 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * configure.in (target_archs): remove temporary objects.nobu2010-12-212-2/+4
| | | | | | * enc/Makefile.in, enc/depend (clean): remove work directories. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@30286 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/big5-hkscs-tbl.rb: Update table as HKSCS-2008.naruse2010-11-243-4/+37308
| | | | | | | | patched by oCameLo oTnTh [ruby-core:33256] * enc/big5.c: add alias Big5-HKSCS:2008 to Big5-HKSCS. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@29922 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/utf_16_32.trans: add the UTF-32 converter.naruse2010-11-241-0/+87
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@29895 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/utf_16_32.trans: add a convert from UTF-8 to UTF-16.naruse2010-11-231-2/+28
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@29892 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/utf_16_32.trans: raise error on unpaired uppernaruse2010-11-231-8/+8
| | | | | | surrogates. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@29891 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/utf_16_32.h: add UTF-16 and UTF-32 as a dummy encoding.naruse2010-11-232-0/+79
| | | | | | * enc/trans/utf_16_32.trans: add a converter from UTF-16 to UTF-8. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@29889 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* Add missing tables.naruse2010-11-224-0/+76244
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@29871 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/big5.c: split CP950 from Big5.naruse2010-11-224-32098/+28
| | | | | | | | | | | | | * enc/big5.c: split CP951 from Big5-HKSCS. * enc/trans/big5.trans: import conversion table of Big5, Big5-HKSCS, CP950, and CP951 from ICU. they need fallback conversions. ref [ruby-core:33256] http://source.icu-project.org/repos/icu/data/trunk/charset/data/ucm/ * tool/transcode-tblgen.rb (import_ucm): add to import ucm files. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@29869 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * win32/Makefile.sub (MAKEDIRS): should not include silent flag.nobu2010-11-173-4/+4
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@29818 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/shift_jis.c (property_name_to_ctype): fix memory leak.naruse2010-11-172-2/+2
| | | | | | * enc/euc_jp.c (property_name_to_ctype): ditto. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@29810 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/Makefile.in (distclean): should not remove sources which arenobu2010-11-141-2/+2
| | | | | | distributed in tarball. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@29783 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * Makefile.in, common.mk, cygwin/GNUmakefile.in, enc/depend,nobu2010-11-121-10/+5
| | | | | | ext/ripper/depend, lib/mkmf.rb, win32/Makefile.sub: caddle up. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@29769 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * common.mk: hide long command lines by default. verbose-mode isnobu2010-11-112-1/+22
| | | | | | | turned on by V=1 as before. http://jarp.does.notwork.org/diary/200605b.html#200605121 git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@29748 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * regenc.c (onigenc_minimum_property_name_to_ctype):naruse2010-11-092-8/+20
| | | | | | | | | | | | | | | \p{...} should be case insensitive. [ruby-core:33000] * regenc.c (onigenc_property_list_add_property): ditto. * enc/euc_jp.c (init_property_list, property_name_to_ctype): to lowercase property names. * enc/shift_jis.c (init_property_list, property_name_to_ctype): ditto. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@29732 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/enc-unicode.rb,naruse2010-11-084-2422/+22004
| | | | | | | | | enc/unicode/name2ctype.h, enc/unicode/name2ctype.h.blt, enc/unicode/name2ctype.kwd, enc/unicode/name2ctype.src: Add Age property to regexp. [ruby-core:33019] patched by Ammar Ali, tested by Run Paint Run Run git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@29717 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/gbk-tbl.rb: Add euro sign. [ruby-core:33094]naruse2010-11-081-0/+1
| | | | | | | CP936, which is de facto definition of GBK, has it. http://msdn.microsoft.com/en-us/goglobal/cc305153.aspx git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@29713 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/enc-unicode.rb,naruse2010-10-294-422/+2448
| | | | | | | | | enc/unicode/name2ctype.h, enc/unicode/name2ctype.h.blt, enc/unicode/name2ctype.kwd, enc/unicode/name2ctype.src: Add 'Unknown' Script. patched by Run Paint Run Run. [ruby-core:32937] #3998 git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@29626 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * tool/enc-unicode.rb,naruse2010-10-284-4920/+6734
| | | | | | | | | enc/unicode/name2ctype.h, enc/unicode/name2ctype.h.blt, enc/unicode/name2ctype.kwd, enc/unicode/name2ctype.src: Update Oniguruma for Unicode 6. patched by Run Paint Run Run. [ruby-core:32923] #3989 git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@29620 b2dd03c8-39d4-4d8f-98ff-823fe69b080e