20.01.2008-2:11:40 :: Remember, remember, the velvet November


node:	20.01.2008-2:11:40
template:	4
parent:	Perl
owner:	wwwnick
viewed by:
created:	20.01.2008 - 02:11:40

cwbe coordinatez:
101
63540
2076399
1655002
3622770

ABSOLUT
KYBERIA

permissions
you:	r,
system:	public
net:	yes

nevite o nejakem kousku kodu ktery by fungoval a odstranoval diakritiku z textu a nahrazoval ji znaky bez diakritky, bez ohledu na velikost pismena a znakovou sadu, tzn č => c a Č => C
google mi poradil zatim jen nefunkcni veci...

Love is just an illusion
In short: just say NO TO DRUGS, and maybe you won\'t end up like the Hurd people.

000001010006354002076399016550020362277005001181

ja len, ze jedna moznost je konvertovat do do UTF-8 NFD a potom len odstranit znaky pre diakritiku :)

000001010006354002076399016550020362277004344295

Nieco take je na CPAN-e - Text::Undiacritic
ale neskusal som to...

000001010006354002076399016550020362277003828091

Tento scriptik som si pred istym casom pisal. Funguje dobre, premenuvava len fajly ktore treba premenovat, cize fajly ktore nemaju diakritiku preskakuje, na konci vypise statistiku kolko fajlov/dirov premenoval a kolko preskocil. Pouziva externu binarku ktoru si vygooglite rychlo. Ak ste moc lenivi a mate toho vela mozete ten script volat rekurzivne zo shellu ak mate vela adresarov a podadresarov.
Nebite ma :) viem ze sa to dalo napisat aj lepsie :)

#!/usr/bin/perl

$dir = `pwd`;
@files = `ls -1`;
chomp(@files);
$skip = 0;
$rename = 0;

foreach $file (@files) {
$filen = `echo "$file" | recode -f l2..flat`;
chomp($filen);
if ($filen eq $file) {
$skip = $skip + 1;
}
else {
print "rename: $file -> $filen\n";
system("mv \"$file\" \"$filen\"");
$rename = $rename + 1;
}
}

print "Statistics:\n";
print "Skipped: $skip\nRenamed: $rename\n\n";

00000101000635400207639901655002036227700382809103828355

jedine co mi na tom vadi ze to je platform dependent. na windowse ti to napr nepomoze. treba pouzivat readdir namiesto ls -1 atd..

000001010006354002076399016550020362277003759453

system ("recode -f utf8..text"); #? :)

000001010006354002076399016550020362277003622911

sprav si hashtabulku, kde keys budu znaky, co chces replacovat, values znaky, ktorymi budes replacovat a prefic text cez nu.

00000101000635400207639901655002036227700362291103699546

dalo by sa to imho elegantne vyriesit cez nejaku regular expression, mam pocit ze v tomto je perl dost dobry.. ale asi len v pripade, ze sa chces naucit nieco o regular expressions... mne chvilu trvalo kym som pochopil wtf...

tento riadok vymeni v $text-e 'bla' za 'BLA'
$text =~ s/bla/BLA

0000010100063540020763990165500203622770036229110369954603700094

a ako chces iterovat v ramci regular expression?

000001010006354002076399016550020362277003622911036995460370009403706776

forcer 16.02.2008 - 03:15:38 (modif: 16.02.2008 - 03:37:26) [1K] , level: 4, UP NEW !!CONTENT CHANGED!!

Re[4]: 20.01.2008-2:11:40

s/xXXX/xXXX/g;
cize si vytvoris hash
napr..

use strict;

use warnings;

my $value;



open(FILE, "diakritika.txt");

my $file = <FILE>;



my %change = ( 

  'č' => 'c',

  'š' => 's',

  'ž' => 'z',

  'ť' => 't',

);

foreach my $key(keys(%change)) {

  $value = $change{$key}; 

  $file =~ s/$key/$value/g;

}

close(FILE);

print $file;

00000101000635400207639901655002036227700362291103699546037000940370677603706954

a sme doma :)

000001010006354002076399016550020362277003622911036995460370009403700473

no, pokial viem, najpohodlnejsie je citat text po riadkoch s "<>" operatorom, napriklad:

while (my $riadok = <$dlhyText>) {
#vymenit BLA za bla
$riadok =~ s/BLA/bla/;
#pridat riadok k hotovemu textu
$vyslednyText = $vyslednyText.$riadok;
}

00000101000635400207639901655002036227700362291103699546037000940370047303701340

ide o to ako vymenit v $riadok naraz ~20 znakov s diakritikou bez toho aby si musel mat pod sebou ~20 rovnakych riadkov :)

0000010100063540020763990165500203622770036229110369954603700094037004730370134003824656

http://perldoc.perl.org/functions/tr.html

000001010006354002076399016550020362277003622911036995460370009403700473037013400382465603828462

super! a teraz si precitaj co chlapik chcel a napis ako vie tr vymenit 20 znakov za 20 inych znakov naraz, bez toho aby si to mal v loop-e :)

00000101000635400207639901655002036227700362291103699546037000940370047303701340038246560382846203828794

ziman 26.03.2008 - 12:05:40 , level: 8, UP NEW

? rtfm? utfb?

#!/usr/bin/perl -w



$_ = "abeceda\n";

tr/abcd/pqrs/;

print;

0000010100063540020763990165500203622770036229110369954603700094037004730370134003701566

no, myslim ze default spravanie tohto "substitute" je ze vymeni vsetky... takze mozes spravit aj $dlhyText =~ s/BLA/bla
...ale nie som si teraz isty... da sa mu nastavit, ze skonci ked najde prve BLA, alebo ze az posledne vymnei, ale imho ked mu to neupresnis vymeni vsetky... ale uz som s tym dlho nerobil

000001010006354002076399016550020362277003622911036995460370009403700471

000001010006354002076399016550020362277003622911036995460370009403700467