textalignment Working with aligned texts in Scala Background Splitting citation and text into parallel collections Zipping up parallel editions

Transcription

1 textalignment Working with aligned texts in Scala Background Recall that a minimal but sufficient model of citable text can be represented by an ordered collection of pairings, where each pairing consists of a citation reference and a chunk of text. In Scala, one natural way to represent this is as a Vector (the ordered collection) of 2-element Arrays. Here's a snippet that reads in a.tsv formatted file from a URL. The source text has one citable unit per line, with citation and text separated by a tab. val texturl = " import scala.io.source val sourcelines = Source.fromURL(textUrl).getLines.toVector Took: 1 second 923 milliseconds, at :37 Splitting citation and text into parallel collections It will be convenient to maintain the list of citations and list of text chunks separately. As long as we keep them in the same order, we can always zip them back together easily. Vectors are always ordered, so we can just create separate vectors for each list. The cell below does that. First, it maps every line of text to an Array created by splitting the line of text on a tab character (\t). As a safety measure, we filter the resulting vector to keep only those items that have exactly 2 items. Then we can separately map the each array to its first element (element 0 - the reference), and its second element (element 1 - the text chunk). val pairings = sourcelines.map(_.split("\t")).filter(_.size == 2) val reff = pairings.map(_(0)) val chunks = pairings.map(_(1)) Took: 1 second 963 milliseconds, at :37 Ignore Zipping up parallel editions Scala's zip method makes it easy to combine two lists element by element. 1/7

2 val analyzedasuppercase = chunks.map(_.touppercase) val citableuppercase = reff.zip(analyzedasuppercase) val citablesourcetext = reff.zip(chunks) Took: 1 second 816 milliseconds, at :46 Looking up (filtering) by citation value By pairing each element of your analyzed text with a citation value, you make it easy to retrieve individual elements with a filter expression. Note that zip creates a tuple, so we'll need to use tuple syntax to match. 2/7

3 citablesourcetext.filter(_._1 == "") 10 entries total Show: Search: 10 When this scheme was disclosed to the Helvetii by informers, they, according to their custom, compelled Orgetorix to plead his cause in chains; it was the law that the penalty of being burned by fire should await him if condemned. On the day appointed for the pleading of his cause, Orgetorix drew together from all quarters to the court all his vassals to the number of ten thousand persons; and led together to the same place, and all his dependants and debtor-bondsmen, of whom he had a great number; by means of these he rescued himself from [the necessity of] pleading his cause. While the state, incensed at this act, was endeavouring to assert its right by arms, and the magistrates were mustering a large body of men from the country, Orgetorix died; and there is not wanting a suspicion, as the Helvetii think, of his having committed suicide. When Caesar inquired of them what states were in arms, how powerful they were, and what they could do in war, he received the following information: that the greater part of the Belgae were sprung from the Germans, and that having crossed the Rhine at an early period, they had settled there, on account of the fertility of the country, and had driven out the Gauls who inhabited those regions; and that they were the only people who, in the memory of our fathers, when all Gaul was overrun, had prevented the Teutones and the Cimbri from entering their territories; the effect of which was that, from the recollection of those events, they assumed to themselves great authority and haughtiness in military matters. The Remi said that they had known accurately everything respecting their number, because, being united to them by neighbourhood and by alliances, they had learnt what number each state had in the general council of the Belgae promised for that war. That the Bellovaci were the most powerful amongst them in valour, influence, and number of men; that these could muster 100,000 armed men, [and had] promised 60,000 picked men out of that number, and demanded for themselves the command of the whole war. That the Suessiones were their nearest neighbours and possessed a very extensive and fertile country; that among them, even in our own memory, Divitiacus, the most powerful man of all Gaul, had been king; who had held the government of a great part of these regions, as well as of Britain; that their king at present was Galba; that the direction of the whole war was conferred by the consent of all upon him, on account of his integrity and prudence; that they had twelve towns; that they had promised 50,000 armed men; and that the Nervii, who are reckoned the most warlike among them, and are situated at a very great distance, [had promised] as many; the Atrebates, 15,000; the Ambiani, 10,000; the Morini, 25,000; the Menapu, 9000; the Caleti, 10,000; the Velocasses and the Veromandui as many; the Aduatuci, 19,000; that the Condrusi, the Eburones, the Caeraesi, the Paemani, who are called by the common name of Germans, [had promised], they thought, to the number of 40, /7

4 A short time only having elapsed, so that time was scarcely given for arranging and executing those things which they had determined on, the enemy, upon the signal being given, rushed down [upon our men] from all parts, and discharged stones and darts upon our rampart. Our men at first, while their strength was fresh, resisted bravely, nor did they cast any weapon ineffectually from their higher station. As soon as any part of the camp, being destitute of defenders, seemed to be hard pressed, thither they ran, and brought assistance. But they were over-matched in this, that the enemy when wearied by the long continuance of the battle, went out of the action, and others with fresh strength came in their place; none of which things could be done by our men, owing to the smallness of their number; and not only was permission not given to the wearied [Roman] to retire from the fight, but not even to the wounded [was liberty granted] to quit the post where he had been stationed, and recover. In the same condition were the Usipetes and the Tenchtheri (whom we have mentioned above), who for many years resisted the power of the Suevi, but being at last driven from their possessions, and having wandered through many parts of Germany, came to the Rhine, to districts which the Menapii inhabited, and where they had lands, houses, and villages on either side of the river. The latter people, alarmed by the arrival of so great a multitude, removed from those houses which they had on the other side of the river, and having placed guards on this side the Rhine, proceeded to hinder the Germans from crossing. They, finding themselves, after they had tried all means, unable either to force a passage on account of their deficiency in shipping, or cross by stealth on account of the guards of the Menapii, pretended to return to their own settlements and districts; and, after having proceeded three days' march, returned; and their cavalry having performed the whole of this journey in one night, cut off the Menapii, who were ignorant of, and did not expect [their approach, and] who, having moreover been informed of the departure of the Germans by their scouts, had without apprehension returned to their villages beyond the Rhine. Having slain these, and seized their ships, they crossed the river before that part of the Menapii, who were at peace in their settlements over the Rhine, were apprised of [their intention]; and seizing all their houses, maintained themselves upon their provisions during the rest of the winter. Caesar, though he discerned from what motive these things were said, and what circumstance deterred him from his meditated plan, still, in order that he might not be compelled to waste the summer among the Treviri, while all things were prepared for the war with Britain, ordered Indutiomarus to come to him with 200 hostages. When these were brought, [and] among them his son and near relations whom he had demanded by name, he consoled Indutiomarus, and enjoined him to continue in his allegiance; yet, nevertheless, summoning to him the chief men of the Treviri, he reconciled them individually to Cingetorix: this he both thought should be done by him in justice to the merits of the latter, and also judged that it was of great importance that the influence of one whose singular attachment towards him he had fully seen, should prevail as much as possible among his people. Indutiomarus was very much offended at this act, [seeing that] his influence was diminished among his countrymen; and he, who already before had borne a hostile mind towards us, was much more violently inflamed against us through resentment at this. 4/7

5 Acco, who had been the author of that enterprise, on being informed of his arrival, orders the people to assemble in the towns; to them, while attempting this and before it could be accomplished, news is brought that the Romans are close at hand: through necessity they give over their design and send ambassadors to Caesar for the purpose of imploring pardon; they make advances to him through the Aedui, whose state was from ancient times under the protection of Rome. Caesar readily grants them pardon and receives their excuse at the request of the Aedui; because he thought that the summer season was one for an impending war, not for an investigation. Having imposed one hundred hostages, he delivers these to the Aedui to be held in charge by them. To the same place the Carnutes send ambassadors and hostages, employing as their mediators the Remi, under whose protection they were: they receive the same answers. Caesar concludes the council and imposes a levy of cavalry on the states. There in like manner, Vercingetorix the son of Celtillus the Arvernian, a young man of the highest power (whose father had held the supremacy of entire Gaul, and had been put to death by his fellow citizens, for this reason, because he aimed at sovereign power), summoned together his dependents, and easily excited them. On his design being made known, they rush to arms: he is expelled from the town of Gergovia by his uncle Gobanitio and the rest of the nobles, who were of opinion, that such an enterprise ought not to be hazarded: he did not however desist, but held in the country a levy of the needy and desperate. Having collected such a body of troops, he brings over to his 30 sentiments such of his fellow citizens as he has access to: he exhorts them to take up arms in behalf of the general freedom, and having assembled great forces he drives from the state his opponents, by whom he had been expelled a short time previously. He is saluted king by his partisans; he sends ambassadors in every direction, he conjures them to adhere firmly to their promise. He quickly attaches to his interests the Senones, Parisii, Pictones, Cadurci, Turones, Aulerci, Lemovice, and all the others who border on the ocean; the supreme command is conferred on him by unanimous consent. On obtaining this authority, he demands hostages from all these states, he orders a fixed number of soldiers to be sent to him immediately; he determines what quantity of arms each state shall prepare at home, and before what time; he pays particular attention to the cavalry. To the utmost vigilance he adds the utmost rigour of authority; and by the severity of his punishments brings over the wavering: for on the commission of a greater crime he puts the perpetrators to death by fire and every sort of tortures; for a slighter cause, he sends home the offenders with their ears cut off, or one of their eyes put out, that they may be an example to the rest, and frighten others by the severity of their punishment. 5/7

6 All these proposals were rejected, and opposition made to them all, in the speeches of the consul, Scipio, and Cato. An old grudge against Caesar and chagrin at a defeat actuated Cato. Lentulus was wrought upon by the magnitude of his debts, and the hopes of having the government of an army and provinces, and by the presents which he expected from such princes as should receive the title of friends of the Roman people, and boasted amongst his friends, that he would be a second Sylla, to whom the supreme authority should return. Similar hopes of a province and armies, which he expected to share with Pompey on account of his connection with him, urged on Scipio; and moreover, [he was influenced by] the fear of being called to trial, and the adulation and an ostentatious display of himself and his friends in power, who at that time had great influence in the republic, and courts of judicature. Pompey himself, incited by Caesar's enemies, because he was unwilling that any person should bear an equal degree of dignity, had wholly alienated himself from Caesar's friendship, and procured a reconciliation with their common enemies; the greatest part of whom he had himself brought upon Caesar during his affinity with him. At the same time, chagrined at the disgrace which he had incurred by converting the two legions from their expedition through Asia and Syria, to [augment] his own power and authority, he was anxious to bring matters to a war. The Massilians, since their former loss, had brought the same number of old ships from the docks, and had repaired and fitted them out with great industry: they had a large supply of seamen and pilots. They had got several fishing-smacks, and covered them over, that the seamen might be secure against darts: these they filled with archers and engines. With a fleet thus appointed, encouraged by the entreaties and tears of all the old men, matrons, and virgins to succour the state in this hour of distress, they went on board with no less spirit and confidence than they had fought before. For it happens, from a common infirmity of human nature, that we are more flushed with confidence, or more vehemently alarmed at things unseen, concealed, and unknown, as was the case then. For the arrival of Lucius Nasidius had filled the state with the most sanguine hopes and wishes. Having got a fair wind, they sailed out of port and went to Nasidius to Taurois, which is a fort belonging to the Massilians, and there ranged their fleet and again encouraged each other to engage, and communicated their plan of operation. The command of the right division was given to the Massilians, that of the left to Nasidius. 6/7

7 He had made up nine legions of Roman citizens; five from Italy, which he had brought with him; one veteran legion from Sicily, which being composed of two, he called the Gemella; one from Crete and Macedonia, of veterans who had been discharged by their former generals, and had settled in those provinces; two from Asia, which had been levied by the activity of Lentulus. Besides he had distributed among his legions a considerable number, by way of recruits, from Thessaly, Boeotia, Achaia, and Epirus: with his legions he also intermixed the soldiers taken from Caius Antonius. Besides these, he expected two legions from Syria, with Scipio; from Crete, Lacedaemon, Pontus, Syria, and other states, he got about three thousand archers, six cohorts of slingers, two thousand mercenary soldiers, and seven thousand horse; six hundred of which, Deiotarus had brought from Gaul; Ariobarzanes, five hundred from Cappadocia. Cotus had given him about the same number from Thrace, and had sent his son Sadalis with them. From Macedonia there were two hundred, of extraordinary valour, commanded by Rascipolis; five hundred Gauls and Germans; Gabinius's troops from Alexandria, whom Aulus Gabinius had left with king Ptolemy, to guard his person. Pompey, the son, had brought in his fleet eight hundred, whom he had raised among his own and his shepherds' slaves. Tarcundarius, Castor and Donilaus had given three hundred from Gallograecia: one of these came himself, the other sent his son. Two hundred were sent from Syria by Comagenus Antiochus, whom Pompey rewarded amply. The most of them were archers. To these were added Dardanians, and Bessians, some of them mercenaries; others procured by power and influence: also, Macedonians, Thessalians, and troops from other nations and states, which completed the number which we mentioned before. Showing 10 of 10 records Pages: Previous 1 Next Took: 1 second 751 milliseconds, at :46 Build: buildtime-thu Sep 22 14:37:57 UTC 2016 formattedshaversion snapshotf6cd60a95cfc19cbae80285f187da9baec04e436 sbtversion scalaversion sparknotebookversion SNAPSHOT hadoopversion jets3tversion jlinedef-(jline,2.12) sparkversion withhive-false. 7/7