Inspiring

Answered

Simple GREP deletion of lines

Forum|Forum|3 years ago
June 30, 2022
11 replies
1464 views

I'd need a simple find and delete duplicate lines for a 16K items column.

VARIABLE NUMBERS(\t)PAGE NUMBER\p)

Thank you for help

How to

This topic has been closed for replies.

Correct answer Gioyer07

Solution (for newbies like me) has to follow these steps

1) clean the document from spaces, tabs etc. (use show hidden characters).

2) apply grep

find

^(.+\r)\1+
replace
$1

G

Gioyer07AuthorCorrect answer

Inspiring

Solution (for newbies like me) has to follow these steps

1) clean the document from spaces, tabs etc. (use show hidden characters).

2) apply grep

find

^(.+\r)\1+
replace
$1

pixxxelschubser

Community Expert

Please upload an 1 page example IDML (with no confidential data, but enough samples) on a hoster of your choise and link here.

G

Gioyer07Author

Inspiring

I uploaded it here using Wetransfer. The link is usually available only a week and I wonder if the 4 Mb document would be more useful to be uploaded somewhere else, with no expiry date for other potentially interested users. Thank You so much.

L

Laubender

Community Expert

Hi @Gioyer07 ,

usually the issue with duplicate paragraphs should be solved with the data source.

So that duplicate paragraphs will not show up in InDesign after placing the content.

Regards,
Uwe Laubender
( Adobe Community Professional )

G

Gioyer07Author

Inspiring

Thank you Laubender

That would be a solution if only backend data would know the page number of all the codes. Happens that knows not and never will but they are needed for printing.

pixxxelschubser

Community Expert

Hallo Uwe

Leider nein. So einfach ist es nicht. Sieh dir bitte noch einmal die ersten Screenshots an.

Ziffern (variabel zwischen 7-10)
Buchstabe (eventuell 1x)
Leerzeichen (eventuell mehrere)
verankertes Objekt (eventuell, Position unbekannt)
Tabulator (Zeilenspalter)
Ziffern (variabel Anzahl vielleicht bis 4 ??)
Absatzende

L

Laubender

Community Expert

Thank you, @pixxxelschubser !

You are right! Then we have to talk about "sameness" and the flexible patterns with \K. And what that means for atomic groups. Or we have to take a shortcut and write a script. 🙂

Let's see what our OP thinks about all this…

Thanks,
Uwe Laubender
( Adobe Community Professional )

G

Gioyer07Author

Inspiring

This is beyond my skills... The only thing I am sure of is that I failed also the title, because it's not "Simple" indeed... Thank you to the experts that replies or propose usable solutions. At the moment I just can't say that it is "solved".

L

Laubender

Community Expert

Hm.

Perhaps its better as a first step to get rid of possible white space characters between the first range of digits and the right align tab and then tackle the issue with duplicate paragraphs. I'm not sure if the number of white spaces after the first range of digits is always the same. ( Just a guess of course. )

Regards,
Uwe Laubender
( Adobe Community Professional )

pixxxelschubser

Community Expert

Strange that the Grep finds anything at all. There are spaces between the numbers and the tab, which you did not mention before.

L

Laubender

Community Expert

Hi together,

I would try this one:

Find GREP:

(\d{7}\h{2}~y\d{3}\r)\1

Change GREP:

$1

Do that two or more times until nothing is found.

And let's hope that the pattern for all paragraphs* is:

A range of 7 digits followed by two horizontal white spaces followed by a right alligned tab followed by a range of 3 digits followed by a end of paragraph special character.

[*] I can see from the screenshot that we perhaps also have to deal with anchored objects.

Regards,
Uwe Laubender
( Adobe Community Professional )

pixxxelschubser

Community Expert

No.

That is not what I mean!

Go to menu: Type --> Show hidden characters (or similar)

Then the hidden characters will shown as blue characters/signs.

and create a new screenshot for us.

G

Gioyer07Author

Inspiring

Thank you for patience, here is the correct screenshot.

I applyed

(\d+~y\d+\r)\K\1

in the Find line and nothing in the Replace line.

Pressing 'Replace All' gave one substitution (while there are hundreds of exactly equal lines), pressing again 'Replace All' produced zero other findings/deletion.

G

Gioyer07Author

Inspiring

pixxxelschubser

Community Expert

… The screenshot precisely shows the hidden characters in the white box…

By @Gioyer07

Are you sure? Which screenshot do you mean?

Both screenshots of you show guides and layout lines - but the hidden characters are not visible.

That mean: menu: Type --> Show hidden characters

[Ctrl/Strg]+[Alt]+[I]

G

Gioyer07Author

Inspiring

Thank you... well if you look the guides and layout lines you certainly see them.... but in the find/replace window you can clearly see the hidden characters... perhaps you need to click it and see it full screen if you can't see it in the chat

pixxxelschubser

Community Expert

To remove one following duplicate you can try something like that:

(\d+~y\d+\r)\K\1

if numbers tab numbers end of paragraph

If that does not work - please show a screenshot with visible hidden characters.

G

Gioyer07Author

Inspiring

Thank You very much for the answer. Excuse the delay I had the office computer off. The screenshot precisely shows the hidden characters in the white box. Your solution seems to be right, please allow some time to duoblecheck it. Thank You

M

Manan Joshi

Community Expert

Hi @Gioyer07,

To understand the issue properly, are the duplicate lines always adjacent lines and we need to detect the duplicates and keep only a single instance?

-Manan